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GENERALIZED DIFFERENTIATION OF PIECEWISE LINEAR FUNCTIONS 
IN SECOND-ORDER VARIATIONAL ANALYSIS^ 
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Abstract. The paper is devoted to a comprehensive second-order study of a remarkable class of con¬ 
vex extended-real-valued functions that is highly important in many aspects of nonlinear and variational 
analysis, specifically those related to optimization and stability. This class consists of lower semicontin- 
uous functions with possibly infinite values on finite-dimensional spaces, which are labeled as “piecewise 
linear” ones and can be equivalently described via the convexity of their epigraphs. In this the paper 
we calculate the second-order subdifferentials (generalized Hessians) of arbitrary convex piecewise linear 
functions, together with the corresponding geometric objects, entirely in terms of their initial data. The 
obtained formulas allow us, in particular, to justify a new exact (equality-type) second-order sum rule 
for such functions in the general nonsmooth setting. 
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1 Introduction 

Variational analysis has been well recognized as a rapidly developed area of nonlinear analy¬ 
sis, which particularly addresses optimization-related and equilibrium problems, control systems 
governed by DDEs and PDEs as well as their numerous applications. Furthermore, this broad 
area of research also deals with many nonvariational issues (stability and generalized differen¬ 
tial calculus are among them), which can be resolved by employing variational principles and 
techniques; see, e.g., the books [1, 16, 27] and the references therein. 

Since nonsmooth functions, sets with nonsmooth boundaries, and set-valued mappings (mul¬ 
tifunctions) naturally and frequently appear in variational analysis even for problems with non¬ 
smooth initial data, concepts and machinery of generalized differentiation play a fundamental 
role in many aspects of variational theory and applications. Extended-real-valued functions, 
which are usually assumed to be lower semicontinuous (l.s.c.), belong to the central objects of 
variational analysis giving us a convenient framework for the unified study of functions and sets, 
combining analytic and geometric methods of their investigation, and having various applications 
to constrained optimization, stability, and other variational and nonvariational issues. 

In this paper we pay the main attention to the study of convex and l.s.c. extended-real-valued 
functions </?: M” ^ M := (—oo, oo], which can be defined geometrically as those whose epigraphs 
epi(^ := {{x,iJ,) G /r > ip{x)} are convex polyhedra/polyhedral sets; see Section 3 for 

analytic descriptions and additional properties. This class was introduced by Rockafellar [26], 
even without the convexity requirement, under the name of piecewise linear functions in the 
framework of the so-called epi-subdifferentiability of extended-real-valued functions. Over the 
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years, it has been recognized the importance of piecewise linear functions for their own sake and 
also as a key building block in the construction of fully amenable functions playing a crucial role 
in second-order variational analysis and its numerous applications to constrained optimization 
and related topics; see [27] and the subsequent publications listed, e.g., in [20]. 

Our major focus here is on studying the second-order subdifferentials (or generalized Hes¬ 
sians) of convex piecewise linear functions in the sense initiated by Mordukhovich [13] for general 
extended-real-valued functions; see Section 2 for the precise definitions. These constructions and 
their modification have been widely used in second-order variational analysis and its applications 
to stability issues and necessary optimality conditions for various classes of optimization-related 
and optimal control problems as well as for parametric variational and equilibrium systems. We 
refer the reader to [13, 14, 16, 19, 24] for the original motivations and underlying results involving 
the second-order subdifferentials and also to [2, 3, 4, 5, 8, 9, 10, 11, 12, 17, 18, 20, 21, 22, 23, 28] 
and the bibliographies therein for more recent studies and applications. 

The effective implementation of the obtained general results requires explicit calculations 
of the second-order sub differentials entirely via the problem data. Such calculations can be 
found in many publications, including the ones listed above. Among those given for particular 
subcollections of convex piecewise linear functions, we mention calculating the second-order 
subdifferentials for the indicator functions of convex polyhedra presented in [6] via the explicit 
but not easily implementable “critical face” condition and in [9, 11, 28] obtained in significantly 
more effective terms involving index sets associated with polyhedral constraints. Quite recently, 
the complete second-order calculations have been done in [7, 8] for certain subclasses of the 
maximum functions, which also belong to the collection of all (convex) piecewise linear ones. 

Of course, the calculations obtained for particular classes of functions can be extended to 
their various combinations provided the availability of appropriate second-order calculus rules. 
We distinguish between the exact (equality-type) calculus rules giving us precise expressions of 
the second-order subdifferentials for the function combinations under consideration via those 
of the components involved vs. the corresponding inclusions ensuring only upper estimates. 
While the second-order subdifferential sum and chain rules of both types can be found in 
[15, 16, 17, 19, 20, 22], we emphasize the following two issues closely related to our subsequent 
study: (i) The exact second-order sum rules are available only when one of the summands is 
-smooth (or a little less: C^-smooth with the strictly differentiable derivative at the reference 
point); see [16, Proposition 1.121]. (ii) We have the exact second-order chain rule for a subclass 
of fully amenable compositions with convex piecewise linear extended-real-valued outer func¬ 
tions obtained in [20, Theorem 4.3] under a certain second-order qualification condition (SOCQ) 
involving the second-order subdifferential of the outer function at zero. 

The main contribution of this paper is a precise calculation of the basic second-order sub¬ 
differential for the general class of convex and piecewise linear functions in finite dimensions 
entirely in terms of their given data. As a consequence of these calculations, we justify the exact 
second-order sum rule for such functions, which is the first result of this type allowing all the 
summands to be nonsmooth and even extended-real-valued. Furthermore, the given calculations 
make it possible to express the aforementioned second-order chain rule for fully amenable compo¬ 
sition and the corresponding SOCQ explicitly via the parameters of piecewise linearity. Various 
specifications of the general results obtained are also discussed. As a by-product of these de¬ 
velopments, we calculate some second-order constructions and their geometric associates, which 
are preliminary in our consideration while playing a major role prior to the performing crucial 
limiting procedures and being certainly of their own interest. 

The rest of the paper is organized as follows. Section 2 recalls some definitions and facts from 
generalized differential theory of variational analysis needed for the formulations and proofs of 
the subsequent results. In Section 3 we define the class of (convex) piecewise functions, present 
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their equivalent descriptions, and derive their first-order properties needed in what follows. 

In Section 4 we start a local second-order analysis of piecewise linear functions calculat¬ 
ing geometric second-order constructions generated by certain “prenormals” to the (first-order) 
subdifferential and its graph, which may be a nonconvex set despite the convexity of piecewise 
linear functions under consideration. Although the constructions used in this section are non- 
robust and do not possess desired calculus rules, the obtained second-order calculations provide 
useful tools of analysis and eventually lead us to complete calculations of the basic second-order 
subdifferential by performing appropriate limiting procedures in the subsequent sections. 

Section 5 is the culmination of the paper. It presents explicit and easily implementable 
calculations of the second-order subdifferential and related constructions for the general class 
of convex piecewise linear functions entirely via their given parameters. As a product of these 
calculations, we justify the aforementioned second-order subdifferential sum rule involving such 
functions. Section 6 is devoted to some specifications and improvements of our general results 
for the case of the maximum functions while extending in this way the recent results from [7, 8]. 

Our notation and terminology are standard in variational analysis and generalized differ¬ 
entiation; see, e.g., [16, 27]. Recall that, given an nonempty set Q, C M”, the notation coll, 
conell, bdH, intll, cl 11, and span II stands for the convex hull, conic hull, boundary, interior, 
and closure of H, as well as the smallest linear subspace containing H, respectively. Furthermore, 
X ^ X indicates that x ^ x with x G H. For a set-valued mapping F:W^ ^ the symbol 

Lims_upF(x) := jy G R™ 3 Xk ^ x, yk ^ y with yk G F{xk), k G IN := {1,2,.. .}\ (1.1) 

signifies the Painleve-Kuratowski outer limit ol F as x —>■ x. 

2 Tools of Generalized Differentiation 

Based mainly on [16, 27], we introduce and briefly discuss here some notions of generalized 
differentiation in variational analysis widely used in what follows. Starting with geometric 
constructions, for a nonempty set II C R” define the prenormal cone (known also as the regular 
or Frechet normal cone) to H at x G H by 

A^(x; H) := G R"" lim sup^ < o|. (2.1) 

t n \\u - x\\ ) 

U^X 

We choose the prefix “pre” for (2.1) and the related analytic constructions to emphasize that, 
e.g., (2.1) is not a proper normal cone, since it is often trivial (reduces to {0}) at boundary 
points of simple nonconvex subsets of R^, which does not correspond to the meaning of normals. 
The things change when we employ the limiting procedure via (1.1) giving us us the normal 
cone (known as the limiting, basic, or Mordukhovich one) 

^"(x; H) = Limsup A'"(x; H) (2.2) 

n _ 

X^X 

to n at X G H nontrivial at boundary points. In spite of (in fact due to) its nonconvexity, the 
normal cone (2.2) together with the associated coderivative and subdifferential constructions 
(see below) enjoy full calculus induced by variational/extremal principles of variational analysis. 
Note that the prenormal cone (2.1) is convex being dual/polar 

A'(x; n) = T(x; n)* := |x G R"' {v,w)<0 for all wGT{x;Q)'^ (2.3) 
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to the (Bouligand-Severi) tangent/contingent cone T{x;VL) to at x G hi is defined by 

T(x; O) := |za G 3 x^ -4- x, > 0 with ak{xk — x) —>■ ta as k ^ oo|, (2.4) 

while the normal cone (2.2) cannot be tangentially generated due to its intrinsic nonconvexity. 
If n is convex, both cones (2.1) and (2.2) reduce to the classical normal cone of convex analysis. 

Given an extended-real-valued function —>■ M with dom(/5 := {x G (p{x) < oo}, we 

dehne the (first-order) subdiff'erential of (/9 at x G dom (p by 

9(/?(x) := |u G M” (u, —1) G A^((x, V9(x)); epi V9)| (2.5) 

via the normal cone (2.2) to its epigraph; see [16, 27] for the equivalent analytic descriptions. 
Note that dS{x;Q) = N'(x;fl), x G fl, for the indicator function = 5n(-) of Q, dehned by 

5{x] n) := 0 if X G n and 5{x] fl) := oo if x ^ fl. 

Considering next an arbitrary set-valued mapping F: M"" with the domain and graph 

domF:=|xGM"' F(x)/0|, gphF: = |(x,y) G M” x x G F(x)|, 

dehne its precoderivative and coderivative at {x,y) G gphF by respectively, 

i)*F(x,y)(u) := |u G (u,-u) G iV((x,y);gphF)}, u G (2.6) 

F>*F(x,y)(u) := {u G M” (u,-u) G iV((x,y);gphF)|, u G M™. (2.7) 

If F = /: R” —> R”^ is single-valued and C^-smooth around x, then we have 

F7(x)(u) = F*/(x)(u) = {v/(x)*u} for all u G R’”, 

where y = /(x) is omitted and the sign * signihes the matrix transposition. 

Following now the dual-space “derivative-of-derivative” approach to second-order generalized 
differentiation [13] of extended-real-valued functions (p: R” ^ R, we dehne the second-order 
subdifferential of at x G dom(/9 relative to u G dip{x) by 

d‘^(p{x,v){u):= {D*dip){x,v){u), u G R”, (2.8) 

which is the main object of our study. If (p is C^-smooth around x, then 

d‘^(p{x){u) = |v^(^(x)m| for all u G R"" 

via the (symmetric) Hessian V^</9(x), and so (2.8) is viewed as a generalized Hessian of (p at x. 

3 Piecewise Linear Functions via First-Order Study 

Recall [26, 27] that —>■ R is piecewise linear if its domain dom(/9 is nonempty and can be 

represented as the union of hnitely many convex polyhedral sets so that on each of these pieces 
(p is given by (a, x) — a with some a G R and a G R”. Observing that such functions are not 
necessarily convex, we focus on the study of convex piecewise linear (CPWL) functions, which 
admit the following equivalent descriptions [27, Theorem 2.49]. 
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Proposition 3.1 (convex piecewise linear functions). The following are equivalent: 

(i) ip:W^ ^ W is a convex and piecewise linear function labeled as (p G CPWL. 

(ii) The epigraph epi(^ is a convex polyhedron in 

(iii) There are a* G R and ai G R"" for iGTi such that p> is represented by 


ly.: ^ / max|(ai,x) -Oi,.. 

. ,{ai,x) - ai'^ ifxGdomip, 

(3.1) 

\ 00 

otherwise 



with some I G JN, where the set dom ip is a convex polyhedron given by 

dom (/9 = |x G R” {di,x) < I3i for all i G T 2 := {1,..., m}| 
with some di G R”, /3i G R, and m G JN. 


(3.2) 


It follows from (3.1) that any ip G CPWL can be represented in the sum form 

(/9(x) = max |(ai, x) — oi,..., (oi, x) — + (J(x; dom (/?), x G R"", (3.3) 

where both summands are nonsmooth. Note that CPWL functions may be given in other forms 
different from (3.3), e.g., as the support function of a convex polyhedron 

ip{x) = ap{x) := sup{(p,x)| p G P}, 

which is conjugate to the indicator function of P. Thus ap is CPWL by [27, Theorem 11.14(a)]. 

The next simple while important observation, giving in particular some relationships between 
the parameters in (3.1) and (3.2), easily follows from Proposition 3.1. 


Proposition 3.2 (domain of CPWL functions). Let (p be CPWL. Then we have: 

(i) dom(^ = |Ji=i C'i, where I is taken from (3.1) and the sets Ci, i G Tj, are defined by 

Ci := |x G dom(^ — aj < {ai,x) — a* for all j G Ti|. (3.4) 

(ii) ip can be equivalently represented via the pieces of linear functions on Ci: 

ip{x) = {ai,x) — ai for all x G Ci, i gTi. 

Proof. The inclusion Ci C dom p> follows from the construction of Ci. The reverse inclusion 
is a consequence of (3.1). The assertion in (ii) comes directly from (3.4). A 

To proceed further, take ip G CPWL with x G dormp and consider the index set 

iL(x):=|iGTi x G Cij, 

where each Ci is defined in (3.4). It is easy to see that 

{aj,x) — aj = {ai,x) — cti for any i,j G K{x). 

The next proposition collects basic first-order subgradient facts for CPWL functions. 


(3.5) 

(3.6) 


Proposition 3.3 (first-order subdifferential of convex piecewise linear functions). Let 

ip G CPWL with X G dom. ip, and let K{x) be defined in (3.5). The following hold: 

(i) For any x sufficiently close to x we have dip{x) C dip{x). 

(ii) The first-order subdifferential of ip at x is represented by 


dip{x) = co^ai i G iL(x)|-|-N(x; dom (^). 


(3.7) 
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Proof. The sub differential inclusion in (i) follows directly from the piecewise linear representa¬ 
tion of Proposition 3.2(ii) with C* taken from (3.4). To justify (3.7), apply to (3.3) the classical 
sub differential sum rule of convex analysis and then the subdifferential formula for the maximum 
function in (3.1), where (3.5) is the set of the corresponding active indexes. A 

Note that the normal cone in (3.7) can be calculated explicitly via the given data of the 
polyhedral set dom(/? from (3.2). To do it, consider the set of active domain indexes 

I{x):=^ieT 2 {di,x) = (3.8) 

for (3.2) at a; G dome/? and recall the well-known tangent cone representation 

T(a;;dom(/?) = |a: G {di,x) < 0 for all i G 7(7)|, (3-9) 

which gives in duality the normal cone one to the polyhedral domain 

A(x;dome/?) = I ^idi /Uj > o|. (3.10) 

iei(x) 

Take now {x,v) G gphclc/? and deduce from Proposition 3.3(ii) the representation 

V = vi + V 2 with some ui G co|ai i € K{x)'^ and 72 G A(x; dome/?), (3-11) 
which allows us to find by (3.10) such A* > 0 and /fj > 0 that 

7i = AjUj and V 2 = p-A with Aj = 1. (3-12) 

i^K{x) iGl{x) iGK{x) 

Corresponding to (3.12), define the index sets of positive multipliers by 

J+(x,7i) := |z G K{x) Aj > o| and J+(x, 72 ) := |i G I{x) pi > o|. (3.13) 

The next result gives us an effective description of the points in the subdifferential graph 
for CPWL functions. It is certainly of its own interest while playing an important role in the 
subsequent calculations of second-order constructions for such functions. To provide a better 
understanding of it, consider the diagrams presented in Fig. 1 and Fig. 2. Given A: = (x, v) = 
(1,1) G gY>\id(p, we have 7 = 1 G d(p{l) = [^, 2] and so 7 = Ai^ -|- A 22 with A = (Ai, A 2 ) = (|, 5 ). 
This tells us that J+(x,7i) = {1,2}, where 7 = 7i. Suppose that (x,u) is a point of gphfl(/ 9 . 



Fig. 1: Graph of (p Fig. 2: Graph of dp 
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which is sufficiently close to A. As can be observed from the graph of d(p, the only possibility 
for converging to A while remaining in the graph of d(p is (x, v) = (1,1 ± e) when e 0. Thus it 
confirms that x ^ Ci (1 C 2 = {1} and hence x G C* for i G J+(x, hi). 

Now we are ready to justify this phenomenon for the general class of CPWL functions. 

Theorem 3.4 (description of points in the subdifferential graph of CPWL functions). 

Let if G CPWL with {x,v) G gph-dip. Then there exists a neighborhood O of {x,v) such that 
for any (x, v) G (gphdc/?) n O we have x G niej+(x vi) ^0 where hi and J+(x, hi) are taken from 
(3.12) and (3.13), respectively, and where the polyhedral sets Ci are defined in (3.4). 

Proof. We split the proof into the following major steps with keeping all the notation above. 

Claim 1: Let v = + Hi^qpdi with some Ti,r]i > 0 satisfying = 1? 

P C K{x), and Q C I{x). Then we have the equality 

iGP i&Q iGK{x) i£l{x) 

where the multipliers Xi and jli are taken from (3.12). 

To verify this claim, suppose that v = vi + V 2 for xi = Yi&p V 2 = Yi&q pdi with 

YiepVi = 1 r]i,Ti > 0. Fix j G P and observe that {aj,x) — aj = {ai,x) — a* for any 
i ^ K{x) due to (3.6) and P C K{x). It tells us that 

{aj,x) - aj = {vi,x) - ^ AjOj 

iG.K{x) 

with hi taken from (3.12), which implies in turn that 

(Ti,x) - = (hi,x) - ^ AiOj. (3.15) 

j&P i£K{x) 

Since Q C I{x), this allows us to deduce that 

{v 2 ,x) = '^Tif3i and (h 2 ,x) = ^ fiifdi, (3.16) 

i€q i€l{x) 

where V 2 is from (3.12). Combining (3.15) and (3.16) with xi + U 2 = hi + V 2 justifies the claim. 

Suppose now that the conclusion of the theorem does not hold and thus hnd a sequence 
(xfc,Xfc) G gphdv? such that {xk,Vk) (x,h) as k ^ 00 while Xk ^ r\i(^j+{x,vi)^i 
k G ]N. Taking into account that there are only finitely many convex polyhedral sets Ci and 
considering a subsequence of Xk if necessary, suppose that Xk ^ Cs for some s G J+(x,hi). 
Furthermore, it is not hard to see that K{xk) C K{x) for k sufficiently large. Extracting 
similarly another subsequence, pick without loss of generality a constant index subset P C K{x) 
so that K{xk) = P for all k. Select j € P and observe that Xk G Cj, which implies by (3.4) that 

{aj,Xk) — aj > {ai,Xk) — oti for all i G K{x). (3-17) 

On the other hand, the construction in (3.4) and the conditions Xk fL Cg, Xk G dom(/9 allow us 
to select t € Ti independently of k and so that {as,Xk) — ag < {at,Xk) — at- 
Claim 2: IFe have t € K{x) for the index t G Ti selected above. 

Indeed, suppose by contradiction that t ^ K{x). Combining this with s G K{x) tells us that 
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{at,x) — at < {as,x) — and thus {at,Xk) — at < {as,Xk) — as for all k sufficiently large. This 
clearly contradicts the choice of the index t and hence justifies the claim. 

For any fixed s G K(x) define now the index set 


Ds 


;= |f G Ti {as,Xk) — ag < {at,Xk) — at for all k G iv|. 


It follows from Claim 2 that 0 7 ^ C K{x). We continue with the next assertion. 

Claim 3: P C Ds, where P was selected so that K{xk) = P for all k G IN. 

Assuming the contrary, hnd j € P such that j 0 Dg and pick t £ Dg. Employing this gives us 


{as,Xk) — ag < {at,Xk) — at for all k £ M. (3.18) 

Since j ^ Dg, there exists a number ko £ JN for which we have 


{aj,Xko) - oij < {ag,Xko) - ag. (3.19) 

Combining (3.18) for k = ko together with (3.19) leads us to the strict inequality 

{aj,XkQ) aj < (o^jX/jq) at, 

which contradicts (3.17) due to t G K{x) and thus verifies the claim. 

To proceed further, extract another subsequence of Xk and find Q C I{x) with 

{di,Xk) = /3i if i £ Q and {di,Xk) < A if f G T 2 \ Q, 


which shows that I{xk) = Q for all k. The next claim is as follows. 


Claim 4: We have v 


^ co|aj f G P I + cone|(ii i G Q |. 


To verify the claim, suppose on the contrary that there exist vectors ui G co{ai| i £ P} and 
V 2 € cone{(ij| i £ Q} such that v = vi + V 2 . This allows us to find numbers Ti,rii > 0 with 
Vi = ^ such that ui: = V 2 - = YlieQ Pick t £ Dgf] P, which can be done 

by Claim 3. It follows from t £ Dg that 


{as,Xk) - ag < {at,Xk) - at for all k 


while t £ P results in the inequality 


{ai,Xk) — at < {at,Xk) — at whenever i £ K{x). 
Using these two facts together with s £ J+(x,ui) yields 


{vi,Xk) - ^ Kat < {at,Xk) - at, (3.20) 

i^K{x) 

where vi is from (3.11) and the multipliers A* are taken from (3.12). Remembering that {ai,Xk) — 
at = {aj,Xk) — aj for all i,j £ P and taking (3.20) into account ensure that 

{vi,Xk)- ^ Xtat < {vi,Xk)-'^Viai- (3.21) 

ieK{x) ieP 

On the other hand, we know that Xk £ dom^?, which leads us to 

{v 2 ,Xk) < ^ ftiPi and {v 2 ,Xk) = '^TiPi. 
iGl{x) i€Q 
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(3.22) 



Using (3.21) and (3.22) together with vi + V 2 = vi + V 2 gives us 

^ Xiai+ ^ ^ ^ VjC^i ^ ^ • (3.23) 

i£K{x) i£l{x) i£P i£Q 

Appealing finally to Claim 1 along with the inclusions Q C I{x) and P C K{x), we arrive at a 
contradiction with (3.23) and hence verify this claim. 

Now we are ready to finish the proof of the theorem. Remember that {xk,Vk) {x,v), 

which yields Vk € dip{xk) for all k G FV. It follows from (3.7) that dif{xk) = co{aj| i G 
P} + cone{(ij| i G Q} due to K{xk) = P and I{xk) = Q- Hence we have v G co{aj| i G 
P} + cone{(ij| i G Q} thus contradicting Claim 4 and showing that the assumption made after 
Claim 1 cannot be correct, while the opposite is the conclusion of the theorem. A 


4 Calculating Prenormals to Subdifferential Graphs 

Here we start our second-order analysis for a general class of CPWL functions following the 
dual-space derivative-of-derivative approach to second-order generalized differentiation [13] that 
focuses on considering certain normals to (first-order) subdifferential graphs. The main result 
of this section provides a precise calculation of the prenormal/regular normal cone to the graph 
of the sub differential mapping for an arbitrary CPWL function in terms of its given data. As a 
by-product of this, we derive useful formulas for the classical normal and tangent cones to the 
(convex) set of subgradients for such functions expressed via their parameters from (3.1) and 
(3.2). Let us begin with calculations of the latter constructions. 


Lemma 4.1 (normal and tangent cones to subgradient sets of CPWL functions). 

Given (p G CPWL and {x,v) G gph5(/?, take vi, V 2 from (3.12) such that u = ui -|- V 2 - Denote 
by K:= K{x), P.= I{x), Ji := J+(x,ui), and J 2 ■= J+{x,V 2 ) the index sets from (3.5), (3.8), 
and (3.13), respectively. Then we have the following formulas via the data in (3.1) and (3.2).- 
(i) The normal cone to the subgradient set dip{x) at v is calculated by: 


N{v;dip{x)) = |tt G M” (a* — aj,u) = 0 for i,j G Ji, 

{ai - aj,u) < 0 for {i,j) G (iP \ Ji) x Ji, 

{di,u) = 0 for i G J 2 and {di,u) < 0 for i G / \ J 2 |. 

(ii) The tangent cone to dip{x) at v is expressed as 

T{v; dip{x)) = N{v; dip{x))* = T{vi;A{x)) + N{x; dom(/9) -|- R_{i; 2 } 

with N{x;donnp) from (4.2), A{x): = co{aj| i G K{x)}, and T{vi;A{x)) calculated by 

T{vi; A{x)) = span — Oj i, j G Ji|-|-cone|ai — Oj (i, j) G (AT \ Ji) x Ji|. 

Finally, we have the explicit formula for calculating the tangent cone to dp{x) at v: 

T{v;dtp{x)) = span-faj —Uj i, j G Ji|-|-cone|aj — (f, j) G (AT \ Ji) x Ji| 


-|- span \ di 


i G < 72 ! -I- cone|(ij i £ I \ J 2 ^. 


(4.1) 


(4.2) 


(4.3) 


(4.4) 
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Proof. Proposition 3.3(ii) allows us to represent dip{x) = A{x) + B{x) with A{x) from above 
and B{x):= A^(x;dom99) = cone{(ij| i G K{x)} hy (3.10). Since A{x) is convex, we have 


N{vi;A{x)) 


u G 


u G 


{u, vi — hi) < 0 for vi G yl(x)|, 

{u,ai — aj) = 0 for i,j G Ji, 

{u,ai - aj) < 0 for (i,j) G {K \ Ji) x Jij. 


Furthermore, it follows from the structure of B{x) that 

N{v 2 ;B{x)) = B{x)* n {v 2 }^ = r(x;dom(/9) n {v 2 }^ , 
which in turn leads us by (3.9) to the representation 


N{v 2 ', B(x)) = {di,u)=0 for i G J 2 and {di,u)<0 for 


(4.5) 


(4.6) 


(4.7) 


Employing the well-known formula for normals to set additions (see, e.g., [27, Exercise 6.44]) 
shows that N{v;d(p{x)) = N {vi] A{x)) H N {v 2 ; B (x)). This finally brings us to (4.1) due to (4.5) 
and (4.7) and thus justifies the normal cone formula (4.1) in assertion (i). 

To verify now (4.2) in (ii), we apply [25, Corollary 19.3.3] to the set intersection in (4.6) and 
get by [27, Exercise 6.44] and the classical duality between the normal and tangent cones that 


N{v; dip{x))* 


T{v; d^{x)) = cl [T(hi; ^(x)) + T{v 2 ; B{x))] 

T{vi;A{x)) + T{v2; B{x)) = T{vi;A{x)) + N{v 2 ; B{x)Y 

T{vi;A{x)) + ^T{x;domip) n 

T{vi; A{x)) + N{x; dom^j) -|- M_{h 2 }, 


where the last equality follows from [25, Corollary 16.4.2] and the choice of V2 G N{x-,domip). 
The tangent cone formula (4.3) follows from immediately from (4.5) by [27, Lemma 6.45]. 

To establish finally representation (4.4), it remains to use the tangent sum rule T(h; dif{x)) = 
T{vi]A{x)) +T{v2]B{x)) and calculate T{v 2 ]B{x)). By the classical Earkas lemma (see, e.g., 
[27, Lemma 6.45]) we deduce from (4.7) that 


T{v2] B{x)) = span |(ij i G J2^ + cone|(ii i G I \ J 2 I 


and thus complete the proof of the lemma. A 

The next lemma of its independent interest is significantly more involved providing the rep¬ 
resentation of the prenormal cone (2.1) to the nonconvex subdifferential graphs via the tangent 
and normal cones to the convex subgradient sets for arbitrary CPWL functions. It reduces to 
[9, Proposition 3.2] in the case of indicator functions of convex polyhedra, while in the general 
case the proof is based on the subdifferential graph description established in Theorem 3.4. 


Lemma 4.2 (prenormals to subdifferential graphs via tangents and normals to sub¬ 
gradient sets for CPWL functions). In the setting of Lemma 4.1 we have the representation 

N{(x,v)-,gpih.dip) = T{v;dip{x)) x N{v;d(p{x)). (4.8) 


Proof. We designate in the proof of the lemma several major steps as follows. Aiming first to 
justify the inclusion “c” in (4.8), fix {w,u) G N{{x,v);gph.dip) telling us by (2.1) that 


lim sup 

, ^gphdt^,-, 

[X,V) \X,V) 


{w, x — x) + {u,v — v) 
IJx — xJl -|- ||x — x]] 


< 0 . 


(4.9) 
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Letting x = x and v G dip{x) in (4.9) tells us that u G N{v;dip{x)) = N{v]d(p{x)). To justify 
the aforementioned inclusion in (4.9), it remains to show that w G T(v;d(p{x)) = N(v; d(p{x))*, 
which amounts to verifying the inequality 

{w,p)<0 whenever p € N{v] dip{x)). (4-10) 

To proceed, pick p G N{v;d(p{x)), let x^ '■= x + ^p, k G M, and then prove the following fact. 
Claim 1: We have J 2 C I{xk) and xu G flieJi ^ ^ ^defined in (3.4). 

To check first that Xk G dom(/9 as k € iV, we need showing by (3.2) that {di,Xk) < fii for all 
i G T 2 . Pick the generating vector di with i & I and observe that v := v + di € d(p{x) due to 
(3.7). Since p G N{v;d(p{x)), it follows that 

{p,di) = {p,v-v) <0. (4.11) 

Employing (4.11) together with x G dom(^ yields 

{di,Xk) = {di,x) + k~^{di,p) < fii + fe~^(0) = fii whenever i G /. 

The latter inequality holds also for i € T 2 \I by {di, x) < fii and x^ —> x- Thus we get x^ G dom p. 

Further, pick t G Ji and show that x^ G Ct, which means that {aj,Xk) — cnj < {at,Xk) — o-t, 
or equivalently {aj — at, x^) < aj — at for any j G Ti. Indeed, for j G Ti \ FT the latter inequality 
is a consequence of {aj — at,x) < aj — at and x^ —> x- Observe otherwise that 

{aj — at,x) = aj — at for j G K. (4-12) 

It follows from the representation of vi in (3.12) that At > 0 therein if t G Ji. Take now 
0 < e < At and get v := YlieK Ai«i G dp{x) with 

{ At — e if i = t, 

\j + e if i = j, 

Xi otherwise. 

Sincep G N{v-, dp{x)), we get {p,e{aj—at)) = {p,v—v) < 0 and therefore arrive at {aj—at,p) < 0. 
This allows us to obtain the equalities 

{uj — at, Xk — x) = {aj — at, k~^p) < 0 for all j ^ K, t G Ji, and k G M, 

which in turn imply that {aj — at,Xk) < {aj — at,x) = aj — at by (4.12) and thus verifies Xk G Ct- 
To justifies the claim, it remains to show that J 2 C I{xk), which amounts to saying that 
{p,dt) = 0 for any t G J 2 . Noting that the inequality {p,dt) < 0 follows from (4.11) due to 
J 2 C I, we prove now the converse inequality. Observe that u := ui + Yliei hidi G dp{x), where 
the multipliers pi are defined via fit from (3.12) by 

{ -Pt if i = t, 

Pi otherwise. 

Since p G N{v;dp{x)), we get {p, —^ptdt) = {p,v — v) < 0 yielding {p,dt) > 0 hy pt > 0- It 
shows that {p, dt) = 0, and so t G I{xk), which finishes the proof of this claim. 

Note that it follows from Claim 1 by the definitions of Ji = Jj^{x,vi) in (3.13) and K{x) in 
(3.5) that Ji C K{xk) for all k. Since v G co{aj| i G Ji} + cone{dj| i G J 2 } by the above, we 


11 



have V G d(p(xk), k G ]N. Recalling that {xk,v) {x,v) and substituting {xk,v) into (4.9) 

for {x,v), we arrive at {w,p) < 0, which justifies (4.10) and hence the inclusion “c” in (4.8). 

To verify the opposite inclusion in (4.8), pick {w,u) G T{v;dcp{x)) x N{v;dip{x)) and show 
that it satisfies (4.9). For any {x,v) G gphS^? sufficiently close to {x,v), observe that v G dp{x) 
by Proposition 3.3(i). Then u G N{v;dif{x)) yields {u,v — h) < 0 by the convexity of d(p{x). 
Lemma 4.1(ii) gives us rci G T{vi; A{x)) with A{x) = co{ai| i G K{x)}, W2 G A^(x; dom(/9), and 
7 > 0 such that w = wi + W2 — 'yv2- We proceed further with verifying the following fact. 
Claim 2: We have {wi,x — x) < 0 whenever {x,v) G gphS^j is sufficiently close to {x,v) 

To justify this claim, it suffices to show due to (4.3) that (oj — aj,x — x) =0 when i, j G Ji and 
that {oi — aj,x — x) < 0 when (i,j) G (K \ Ji) x Ji. In the former case we get from (3.6) that 

(tti — aj,x) = ai — aj for all G J\. (4-13) 

Furthermore, x G flieJi C'* by Theorem 3.4. This shows that J\ C Kifc) yielding in turn i,j G 
K (x). Thus {ai,x) — ai = {aj , x) — aj , which together with (4.13) leads us to {ai — aj,x — x) =0. 

To verify the remaining part of the claim, take {i,j) G {K \ Ji) x Ji and deduce from 
Theorem 3.4 that x G Cj. Hence {ai,x) — ai < {aj,x) — aj by (3.4) and therefore we get 
{ai — aj,x — x) < 0 by (4.13), which completes the proof of the claim. 

The next claim gives us the final estimate needed in the lemma. 

Claim 3 : We have the inequality {w2 — 7x2, x — x) < 7(x — v,x — x). 

To verify it, observe that X G dom(/9 and thus get {w2,x — x) < 0 by rc 2 G A^(x; dom (/?). It follows 
from the convexity of ip that dip is a monotone mapping. This tells us that (u — a*, x — x) > 0 
due to u G dipix) and a* G dip{x) for all i G K. Thus we arrive at 

{oi — v,x — x) < {v — v,x — x) for all i G K, 


which in turn leads us to the following relationships: 

{w 2 — 7 x 2 , X — x) < —( 7 x 2 , X — x) = 7 (i;i — v,x — x) =7 ^ Xi{ai — v,x — x) 

ieK 

< 7 Xi{v — v,x — x) = 7 (u — v,x — x) 

iGK 


and thus justifies the claimed inequality. 

To complete finally the proof of the lemma, we combine Claim 2 and Claim 3 together with 
the inequality {u,v — v) <0 obtained above. This allows us to conclude that 

{w, X — x) + {u,v — v) 7 ||ti — nil • ||x — x|| 
llx — x|| + llu — ull “ llx — x|| + llu — ull ’ 


which implies by passing to the upper limit as (x,x) {x,v) that {w,u) G N{{x,v);gphdip) 

and thus verifies the inclusion “D” in (4.8), i.e., the equality therein. A 

Now we are ready to establish the main result of this section, which is a consequence of the 
obtained Lemmas 4.1 and 4.2. This result gives us the precise calculations of the prenormal 
cone to the subdifferential graph of an arbitrary CPWL function and hence its precoderivative 
entirely in terms of the initial CPWL parameters in (3.1) and (3.2). To formulate the result 
and other statements below, we need the following notation. Given any index subsets P, Q with 
Pi G Qi GL Ti and P 2 C Q 2 C T 2 , denote 


^{Pi,Qi},{P2,Q2} ■ 


= span 1 a, 

; Oj 

i, j G Pi| + cone|aj — aj 


+span |dj 

i G P 2 j + cone|dj 

i G Q 2 \ P 2 



(4.14) 
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^{Pi,Qi},{P2,Q2} ■- ^ 


(4.15) 


(a* - aj,u) = 0 if i,j G Pi, 

(oj - aj,u) < 0 if {i,j) G (Qi \ Pi) x Pi, 

{di,u) = 0 if i G P 2 , and {di,u) <0 if i G Q 2 \ P 2 |- 

Observing that the sets P and Q are cones, we conclude from the classical Farkas lemma that 

^{Pi,Qi},{P2,Q2} = ^{Pi,Qi},{P2,Q2} for any Pi C Qi C Ti and P 2 C Q 2 C T 2 . (4.16) 

Note that the following theorem presents the calculation of the aforementioned second-order 
constructions via the fixed index sets Pi and Qi, i = 1, 2, in (4.14) and (4.15). 

Theorem 4.3 (prenormals to subdifFerential graphs and precoderivatives of CPWL 
functions via their initial data). In the setting of Lemma 4.1 we have the following formulas 
with the notation (4.14) and (4.15).' 

(i) The prenormal cone to the subdifferential graph is calculated by 

N{{x,v)]gphdg:>) = x ^{Ji,k},{J 2 I}- (4-17) 

(ii) The domain and values of the precoderivative of (p at (x,v) G gphd0 are calculated by 

{b*dip){x,v){u) = for any u G dom.{b*d<p){x,v) = -Q{j^,k},{J 2 ,i}- (4-18) 

Proof. It follows from (4.4) that T(u; dip{x)) = d^{Ji,K],{J 2 j} and from (4.1) that N{v-, dLp{x)) = 
Thus (4.17) is a direct consequence of Lemma 4.2. The precoderivative calcula¬ 
tions in (4.18) follow from (4.17) due to definition (2.6). A 

A natural question arises on the dependence of the prenormal cone representation (4.17), 
and hence the precoderivative one (4.18), on the choice of vectors vi,V 2 and multipliers Xi,fii 
in (3.11) and (3.12), which are not generally be unique and may potentially influence the cones 
^{.Ji,k},{J 2 ,i} and G{Jj^^k},{J 2 ,i} through the index sets Ji = J+{x,vi) and J 2 = J+(x,'i; 2 ) from 
(3.13). The next proposition shows that it is not the case. 

Proposition 4.4 (invariance of the prenormal cone and precoderivative representa¬ 
tions for CPWL functions). In the framework of Theorem 4.3 we have that the represen¬ 
tations in (4.17) and (4.18) are invariant with respect to any choice of vectors vi,V 2 in (3.11), 
multipliers Xi,Jli in (3.12), and the index sets Ji = J+{x,vi), J 2 = J+(x,'i; 2 ) in (3.13). 


Proof. We only need to verify the invariance of the representations in Theorem 4.3 with respect 
to the choice of vi G co{aj| i G K{x)} and V 2 G A(x;dom0) satisfying v = vi + V 2 - Suppose 
that V = vi + V 2 with vi G co{ai| i G Ar(x)} and V 2 G N{x; dom0) and then get 


Xi = ^ A'tti, 

with 

i^K(x) 


02= h'idi 

with 

i£l{x) 



i^K{x) 


Define the index set of positive multipliers in (4.19) by 

J[ := |i G K{x) A) > o| and J 2 := |f G I{x) pL^ > o|. 
and then clarify the following relationships: 


(4.19) 


(4.20) 


G{JuK},{J 2 j }and J^{j^^k}IJ 2 ,i} - i^{J[,K},{J 2 L}- 
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To proceed, pick u G &{Ji,k},{J 2 ,i} get for V 2 and v from above that 

{v 2 ,u) = 0 and {v 2 ,u) < 0. (4.22) 

Taking now s G Ji implies via (4.22) that 

{as,u) = {vi,u) = {vi +V2- V2,u) < {vi,u) 

= ( Kai,u^ = \i{ai,u)+ K{ai,u) 

i€K{x) i€J[\Ji ieJ(nJi 

= Y + ( Y 

In this way we arrive at the estimate 

Y K{ai,u)>(l- Y (4.23) 

i€J[\Jl iGJ(nJi 

It follows from the equality 1 - EieJ(nJi K = Eiej;\Ji with u G G{Ji,k},{J2,i} that 

(1- Y ^i)(as,«) = ( Y ^ K{ai,u) (4.24) 

iGJ(nJi ieJ{\Ji 

Employing next (4.23) together with (4.24), we deduce that 

Y K{ai,u) = (l- Y (4.25) 

i€J[\Jl iGJ(nJi 

which tells us that {ai,u) = {as,u) for all i G J[\ Ji. Indeed, supposing {ai,u) < {as,u) for 
some i G J[ \ Ji, leads us to a contradiction with (4.25). This allows us to obtain 

{tti — aj,u) = 0 whenever i,j G J[. (4.26) 

Taking now t G K\J[ and s G Ji, we claim that {at — as,u) <0. Indeed, for f 0 Ji the latter 
inequality comes from u G The opposite case of f G Ji yields {at — as,u) = 0, 

which therefore justifies the claim. Since {ai,u) = {as,u) for all f G \ Ji, we get 

{at — ai,u) < 0 whenever {t,i) G {K \ .][) x J(. (4.27) 

It follows from the above arguments that {vi — vi,u) = 0, and hence 

{V2,u) = {V2 + hi - Vl,u) = {V2,u) = 0. 

The obtained relationships allow us to deduce that 

{di ,u) = 0 for all i G J2 and {dt , tt) < 0 for all i G I \ J2, 

which implies together with (4.26) and (4.27) that u G and so G{Ji^k},{J2,i} ^ 

G{j[,k},{j^,i}- The opposite inclusion can be verified by the same arguments. Finally, the 
second equality in (4.21) follows from the first one by using the polarity in (4.16). A 
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5 Second-Order Subdifferential of Piecewise Linear Functions 

In this section we present our major calculations concerning the second-order subdifferential 
(2.8) for the general class of CPWL functions. The final formulas obtained here give us precise 
expressions of the domain and values of the second-order subdifferential mapping entirely via 
the CPWL data in (3.1), (3.2). Several consequences of the main results are also derived below. 

To begin with, we introduce some notation in addition to those formulated in Section 3. 
Given a pair {x,v) G gph(^ for a CPWL function —>■ M, define the index family 

D{x,v) := |(Pi,P 2 ) C K{x) X I{x) v G co{aj| i G Pi}-|-cone{(ij| i G P 2 }|, (5.1) 

for any Qi C K{x) and Q 2 C I{x) consider the set 

^{Qi,Q 2 } ■= ^ domv? K{x) = Qi, I{x) = Q 2 }, (5.2) 

and then introduce the collection of index quadruples 

^:= {(Pi,Qi,P2,g2)| Pi c Qi c p:(x), P2 c Q2 c/(x), 

(Pi,P 2 )GP(x,i;), 

Recalling the constructions of •^{Pi,Qi},{P 2 ,Q 2 } ^{Pi,Qi},{P 2 ,Q 2 } ™ (4.15), we first 

derive the following representation of the second-order subdifferential values for CPWL functions 
involving the index quadruples from (5.3). It essentially extends the result and technique from 
[9, Theorem 4.1] developed for indicator functions of convex polyhedra. 

Theorem 5.1 (second-order subdifferential values via the union of index subsets). 

Let If G CPWL with (x,v) G gphd(p, and let the set A be defined in (5.3). Then the limiting 
normal cone to gphd^? at {x,v) represented as follows: 

N{{x,v);gP^dip) = IJ J^{PuQi},{P2,Q2} ^S{Pi,Qi},{P2,Q2}- (5-4) 

{Pi,Qi,P2,Q2)€A 

Hence the values of the second-order subdifferential d‘^(p{x, v) at any u G M” are given by 

d‘^ip{x, v)(u) = ju; G M” (w, —u) G P [PuQi},{P 2 ,Q 2 } ^ ^{Pi,Qi},{P 2 ,Q 2 }’ (A, Qi, P 2 , Q2) G -4|. 

Proof. It suffices to verify the normal cone representation (5.4), which yields the second- 
order subdifferential formula directly by definitions (2.7) and (2.8). Starting with the proof 
of the inclusion “c” in (5.4), pick any {u,w) G A^((x, h); gphd^?) and find by (2.2) sequences 

{uk,Wk) iu,w) and {xk,Vkf'^^ix,v) satisfying 

{uk,Wk) € N{{xk,Vk);gph.dip) for all k e IN. (5.5) 

It follows from (5.5) and the index set definitions in (3.8), (3.5) with L = /(x) and K = K{x) 
that I{xk) C / and K{xk) C K. By passing to a subsequence if necessary, we have 

K{xk) = Qi and I{xk) = Q2 whenever k € LN (5.6) 

for some index subsets Qi C L and Q 2 C K. It implies by (5.2) that Xk G P{Qi,Q 2 } 7^ 
get by (5.5) that Vk G dip{xk), and so Proposition 3.3(ii) tells us that Vk = vik + V 2 k for some 
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vik G co{aj| i G K{xk)} and V 2 k G A^(xfc; dom^?), k G IN. This allows us to show similarly to 
(3.12) that there exist multipliers Xik > 0 and ^ik > 0 for all /c G iV such that 

vik = ^ AifcOj and V 2 k = ^ fJ^ik with ^ = 1. 

i^K{xk) i&K{xk) 

Extracting another subsequence of Xk if needed, find index sets Pi C Qi and P 2 C <52 for which 

Ajfc > 0 if i G Pi, Ajfc = 0 if i G Qi \ Pi, > 0 if « G P 2 , fiik = 0 if « G <52 \ P2- (5.7) 

This yields J^{xk,vik) = Pi, J+{xk,V 2 k) = P 2 and thus leads us by Theorem 4.3(i) to 

N{{xk,Vk)-,gphdcp) = -P{Pi,Qi},{P 2 ,( 32 } x ^{Pi,Qi},{P 2 ,( 32 }> keJN, (5.8) 

for the index sets Pi and Qi, i = 1,2, from (5.6) and (5.7), respectively. It follows from the 
above and the construction of A that 

{uk,Wk) G •P{Pi,Qi},{P 2 ,Q 2 } X Q{Pi,Qi},{P 2 ,Q 2 } (A, Qi, P 2 , Q 2 ) ^ A, k € ]N, 

which justifies the inclusion “c” in (5.4) by passing to the limit as /c —00 due to (5.8). 

To verify the opposite inclusion “D” in (5.4), pick a pair 

{u,w) G IJ •^{Pi,Qi},{P 2 ,Q 2 } ^ ^{Pi,Qi},{P 2 ,Q 2 } 

{Pi,Qi,P2,Q2)&A 

and find an index quadruple (Pi, Qi, P 2 , Q 2 ) G ^ so that 

{u,w) G -P{Pi,Qi},{P2,(32} S{Pi,Qi},{P 2 ,Q 2 }- (5-9) 

Since P{Qi,Q 2 } 7^ 0 by (5-3), find x G H{Qi,Q 2 } get by (5.2) that K{x) = Qi and I{x) = Q 2 - 
Define further the convergent sequence ^ x by 

Xk = k~^x + {1 — k~^)x, k^lN, (5.10) 

and observe similarly to the discussions above that 

I{x) = I{xk) C I{x) and K{x) C K{xk) C K{x) for large k. (5-11) 

Without loss of generality, find a constant set Qi P K{x) such that Qi C Qi and K{xk) = Q'l 
for all k G IN. Let us next justify the following result. 

Claim: We have the equality Qi = Qi- 

It follows from (5.11) that Qi C Q'l and thus it remains to verify the opposite inclusion. Arguing 
by contradiction, suppose that there is t G Q'l with t ^ Qi. This means by construction that 
Xk G Ct for all /c G LV while x ^ Ct. Define the nonempty set 

Et := |s G Ti {at, x) - at < {as,x) - | 

and show that Et D K{x) 7 ^ 0. Indeed, assuming the contrary tells us that s 0 K{x) for any 
fixed .s € Et. Select now j G K{x) such that x G Cj and thus get {as,x) — ag < {aj,x) — aj. 
Combining it with s G Pi gives us the strict inequality 

{at,x') at P {aj,x') 
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which contradicts {aj,x) — aj < {at, x) — at due to j ^ Et and hence justifies Et Ci K{x) 7 ^ 0. 
Select now s € EtCi K{x) and deduce from t G K{x) and (3.6) that 


{at,x) - at = {as,x) - as. (5-12) 

Since t G Q[, we have Xk G Ct for all k G IN and thus arrive at the inequality {as,Xk) — as < 
{at,Xk) — at, which implies in turn that 

k~^[{as,x) - a^] + (1 - k~^)[{as,x) - a^] < k~^[{at,x) - at] + (1 - k~^)[{at,x) - at]. 


Combining it with (5.12) yields {as,x) — as < {at,x) — at. This contradicts the above choice of 
s G Et and therefore verifies the claim. 

To continue the proof of the theorem, we get from this claim due to Proposition 3.3(ii) and 
formula (3.10) for Xk together with (5.11) that 


dip{xk) = cojoi i G Qij + conejdj i G Q 2 ^. 


(5.13) 


Furthermore, it follows from (5.9) and (5.3) that (^ 1 ,^ 2 ) G D{x,v), which gives us by (5.1) that 

(5.14) 


V = AjOj + jj-idi with some Aj,//* > 0 and Aj = 1. 
iePi iGP2 iePi 


Having the multipliers A* from (5.14), we represent Pi = P{ U P” via the index subsets 


P[ := {i G Pi 


A,; > o| and P" := G Pi Aj = o|. 


Fix any t G P{ and take large k G JN so that {2k) ^ < At; then for any i G P" select 0 < r/j < 1 
with X^jgp// rji = ^. Dehne the sequences of multipliers 

r At — {2k)~^ If i = t 

X'it, ’.= \ k~^rii if f G P[' and := fJ-i + k~^ 

i Aj if f G Pi \ {t} 

while observing that A'^ and fi'-f, are positive for i G Pi and i G P 2 , respectively, with 

^ ^ Ajt, — 1, Ajt;. —y Aj and /^jt, —^ ^j as k — y 00 , (5.15) 

iePi 

where Aj and /ij are taken from (5.14). Dehning further the sequences 

Vk ■= vik + V 2 k with vik ■= ^ A't-aj and V 2 k ■= ^ fJ^tkdi, (5.16) 

iePi ieP2 


we deduce from (5.15) that Ufc —>■ h as /c — 00 . It follows from (5.13) that Vk G dip{xk) for 
all k due to Pi C Qi and P 2 C Q 2 . Furthermore, the positivity of X'i^, 1 ^) 1 ^ in (5.16) yields 
J+{xk,vik) = Pi and J+{xk,V 2 k) = P 2 while showing therefore that 

Niixk,Vk);gpl^^) = J='{p^,q^},{P2,Q2} 0{Pi,Qi},{P 2,Q2}^ kGM. (5.17) 

It tells us by (5.9) that {u,w) G N{{xk,Vk)',gph.(p) for all k and finally verifies the inclusion 
{u,w) G N{{x,v)-, gphip) by passing to the limit in (5.17) as A: —)• 00 . This justifies the normal 
cone representation (5.4) and thus completes the proof of the theorem. A 

Although the formulas of Theorem 5.1 do not involve any “foreign” objects for CPWL 
functions, they may not be so easy to get implemented while including the union A of all 
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the index subset quadruples; cf. the calculations of Theorem 4.3 for the ‘prenormal cone and 
precoderivative values involving only the reference index sets I, K, Ji, J 2 . Our next theorem 
presents a precise calculation of the second-order subdifferential domain 


dom9^(/?(x, u) := G M” d‘^ip{x,v){u) / 0| 


given in terms of the aforementioned index sets calculated at the reference points, i.e., entirely 
via the initial data. Besides being of its own importance, the obtained result is crucial for 
the subsequent explicit calculations of the second-order subdifferential values. It significantly 
extends the previous results in this direction derived in [8, 9, 11] for the cases of component 
maximum functions and indicator functions of convex polyhedra, while even in these cases we 
arrive at enhanced formulations with a new device; see more discussions below. 

To proceed, fix {x,v) G gph9(^, recall the notation K := K{x), I := /(x), Ji := J+(x,'i;i), 
and J 2 := J+(x,i; 2 ) from (3.5), (3.8), and (3.13), and then introduce the feature index subsets 


r(Ji) := 

r(J2) := 


i G K 


{ai - aj,u) = 0 for all j G Ji and u G G{Ji,k},{J 2 ,i} }> 
{dt,u) = 0 for all u G G{Ji,k},{J2,1} } 


(5.18) 


defined via G{,Ji^k},{J 2 ,i} from (4.15) and dependent only on (x,x) and the CPWL data, being 
invariant with respect to the choice of vi,V 2 and multipliers in (3.11); see Proposition 4.4. 


Theorem 5.2 (second-order subdifFerential domain for CPWL functions via initial 
data). Let (p G CPWL with (x,v) G gphdcp. Then we have in the notation above that 


dom d‘^ip{x, v) 



0 for i,j G r(Ji) and {dt,u) 


0 for tGr(J 2 )|. (5.19) 


Proof. To verify first the inclusion “D ” in (5.19), pick u G M” from the set on the right-hand 
side of (5.19) and get u G G{PuQi},{P2,Q2} (A, Qi,-P2, Q2) := (Ji, r(Ji), J2, r(^2))- Select 

i G K\r{Ji), t G /\r(J 2 ) and by (5.18) find Ui G Q{Ji,k},{J 2 ,I}: L ^ Ji: and Ut G Q{Ji^k},{J 2 ,I} 
such that {ai — aj^,Ui) < 0 and {dt,ut) < 0. Define further 

Us ■= s(^ Xs'■= X + Vs for some s>0 (5.20) 

ieK\riJi) tei\r(j2) 


and observe that Xg — x = ys & We split the proof into several claims. 

Claim 1: If s > 0 is small enough, then K{xs) = Qi with the above notation Qi := r(Ji). 

To verify this claim, we need to show by recalling the notation in (3.5) and (5.18) that 


{ai — aj,Xs) = ai — aj for i,j G Qi and {ai — aj,Xs) < a^ — aj for (i,j) G (Ti \ Qi) x Qi. 
Picking i,j G r(Ji) and r G Ji allows us to deduce from the constructions above that 


{ai ajyXg x) — {ai a^,Xs x) -1- {a^ aj,Xs x) — {ai ar,ys) T — 9? 

which in turn implies the equality 


{tti — aj,Xs) = {ai — aj,x) = a* — aj whenever i,j G Qi. (5-21) 

Fix i € K \ r(Ji), choose Ui G G{Ji^k},{J 2 ,i} and ji G Ji, and observe that 

(flj iiji) Xg x) — (flj iiji) Vs) — s{ai djn Ui) 

+(ai-aj^,s(^ ^ Ur+ ut'^^ < s{ai - aj^,Ui) < 0. 

reK\riJi),rjii tei\r(j2) 
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which yields (a, — aj^,Xs) < {ai — aj^,x) = Ui — due to i,ji G K. We now implement this 
together with (5.21) to arrive at the inequality 

{tti - ap,Xs) < ai - ap for all {i,p) G {K \Qi) x Qi. (5.22) 

Finally in the proof of this claim, we consider the case i £ Ti \ K. Select j £ Ji and get 


(tti dj^Xg) — {di dj ^ x') -j- (^di dj^ys'). 

Combining this with (a, — dj,x) < a* — aj allows us to find s > 0 small enough to have 

{di - dj,Xs) = {di - dj,x) + {di - dj,ys) < ai - aj. (5.23) 

Indeed, (5.23) is satisfied if the number s is chosen in the interval 


0 < s < 


ai - aj - {di - dj,x) 


A 


I \ {di o,jjY^i£K\r{Ji) ^tei\r(j2) 
Therefore we deduce from (5.21) and (5.23) the estimate 


{di — dj,Xs) < ai — aj whenever (i,j) £ (Ti \ K) x Qi, 

which shows together with (5.21) and (5.22) that K{xs) = Qi for all s sufficiently small. 

Claim 2: If s > 0 is small enough, then I{xs) = Q 2 with the above notation Q 2 ■= r(J 2 ). 
To verify this claim, we need to show by the notation above that 


{dt,Xs) =/3t for t£Q 2 and {dt,Xs) < fit for t£T 2 \Q 2 - 

To proceed, pick t £ r(J 2 ) and get by construction that {dt,Xs) = {dt,x) + {dt,ys) = Pt due to 
(5.18) and ys £ 0 {Ji,k},{J2,i} fo'^ ds from (5.20). Similarly to the proof of Claim 1, for t £ I\T{J 2 ) 
select ut £ Q{.j^,k},{J 2 I} arrive at the inequality 

{dt,ys) = s{dt,ut) + {dt,s(^ Ui+ ^ ^ < s(di, rtt) < 0. 

i&K\T{Ji) r&I\T{J2)x^t 

Implementing this and taking into account that t £ I tell us that {dt,Xs) < {dt,x) = fit- 
Considering next the case of t G T 2 \ /, we get {dt,x) < fit and therefore conclude that 

{dt,Xs) = {dt,x) + {dt,ys) < fit 


if s > 0 is sufficiently. More precisely, it holds when s is selected in the interval 

n ^ ^ ( fir ~ {dr,x) I 

rGT2\i 11 (dr, Z/ie/s'\r(Ji) + J2tei\r(j2) '“tI ^ 

It follows from the above that I{xs) = Q 2 for such s > 0, which justifies the claim. 

Combining the results of Claims 1 and 2 shows that / 0 in (5.2), which yields 

by Theorem 5.1 that •^{Pi,Qi},{P 2 ,Q 2 } d‘^(p{x,v){u) for the selected quadruple (Ti,Qi,T 2 ,Q 2 ) 

from (5.3). It gives us u G domd‘^(p{x,v) thus justifying the inclusion “D” in (5.19). 

Let us continue the proof of the theorem with verifying the opposite inclusion “c” in 
(5.19). Picking u £ dom 8“^ ip{x, v) and w £ d‘^ip{x,v){u) tells us by definition that {w,—u) £ 
N{{x, v), gphdip). By Theorem 5.1 we find a quadruple {Pi,Qi, P 2 ,Q 2 ) £ for which 

{w, -u) £ dqPi,Qi},{P 2 ,Q 2 } X S{Pi,Qi},{P 2 ,Q 2 }- (5-24) 
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Claim 3 : We have Ji C Qi = K{x) and J2 ^ Q2 = I{x) for some x G dom(^ close to x. 
Furthermore, it holds x — x G G{Ji,k},{J2,i}- 

To justify this claim, take x G and then construct x^ by (5.10) and by (5.16). 

It is showed in the proof of Theorem 5.1 that {xk,Vk)^^^^^^{x,v), K{xk) = K(x) = Qi, and 
I{xk) = Hx) = Q2- Further, fix /cq G iV sufficiently large and define x := x^q- Thus we get 
K{x) = Qi, and I{x) = Q2- Appealing now to Theorem 3.4, we get Ji C K{x) = Qi. It 
comes from (^1,^2) G D{x,v) that there are numbers Aj > 0 with = 1 and /Uj > 0 

such that V = XliePi + YliGP2 hidi- On the other hand, we know from (3.12) that v = 
YlieJi + Yli£j2 hidi- Remembering that P2 F Q2 = I{x) and I{x) C / allows us to deduce 
that {di,x — x) = 0 for all i G P2, which leads us to the equalities 

Xi{ai,x -x) + '^ Jli{di,x -x) = {v,x - x) = '^ Xi{ai,x - ^ hi{di,x - x) 

ieJi i&J 2 iePi *eP2 

= ^ Xi{ai,x - x) + 0= ^ Xi{ai,x - x). 
i&Pl iePi 

It follows from the inclusions Ji C K{x) and Pi C Qi = K{x) that 

(oj, x) — ai = {aj,x) — aj for any i G Ji, j G Pi. 

Using Pi C K{x) and Ji C K{x), we deduce that 

(oj, x) — ai = {aj,x) — aj for any i G Ji, j G Pi. 

Combining the above equalities brings us to X]ieJ2 hi(di,x — x) = 0. Since {di,x) = {di,x) = f 3 i 
i>Y fii > 0, i G J, we arrive at J 2 C Q 2 = I{x). Finally, by the inclusions Ji C Qi = K{x) and 
•h F Q2 = I{x) we obtain x — x G G{Jj^^k},{J2,i}- This completes the proof of this claim. 

Claim 4: IFe have the inclusions F(Ji) C Qi and F(J 2 ) C Q2. 

To verify them, suppose on the contrary that there is i G F( Ji) \Qi. As mentioned in the proof 
of Claim 3, we have x — x G G{Ji^k},{.J 2 ,i} x defined therein, and so (a^ — aj,x — x) = 0 for 

j G Ji- On the other hand, the inclusion i ^ Qi reduces by (3.4) to (a* — aj,x) < ai — aj for 

j G Qi- Since Ji C Qi and {ai — aj,x) = ai — aj, we arrive at {ai — aj,x — x) < 0, a contradiction 
that justifies the first inclusion in the claim. The second one is proved similarly. 

Claim 5 : If u G M” satisfies ( 5 . 24 ), then we have —u G ^{Ji,r(Ji)},{J2,r(J2)}- 

Indeed, take s G Ji, r G Pi and deduce from Ji C Qi and —u G ^{Pi,Qi},{P2,Q2} {^s—ar, u) > 

0. Suppose now that (a^ — ar,u) > 0. As showed in Claim 3 , v = Ylii<EPi + Yli&P2 hidi, 
which together with —u G f?{Pi,Qi},{P 2 ,Q 2 } 

{v,u) = ^ Xi{ai,u) + ^ fii{di,u) = ^ Xi{ar,u) = {ar,u). (5.25) 

iePi iGP 2 iePi 

On the other hand, we know that v = J 2 i£ji + Yli£j2 P-idi, and thus 

{v,u) = ^ Xi{ai,u) + ^ fli{di,u) > ^ Xi{ai,u) > ^ Xi{ar,u) = {ar,u), (5.26) 

ieJl i£J 2 i£Ji i£Ji 

It contradicts (5.25) and ensures in this way that 

{os — ar,u) = 0 for all s G Ji and r G Pi. (5-27) 
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Thus for any i,j G Ji and r G Pi we obtain the equalities 

(oj — aj,u) = {ai — ttr, u) + {ur — aj,u) = 0. (5.28) 

Take now i G r(Ji) \ Ji and j G Ji. Picking r £ Pi leads us to 

(oj — aj,u) = {ai — Qr, u) + {ar — aj,u) = {ai — ar, u) > 0 (5.29) 

by r(Ji) C Qi and —u G G{Pi,Qi},{P 2 ,Q 2 }- follows from (5.25)-(5.27) that 

fii{di,u) = ^ Xi{ar - ai,u) = 0, 

which gives us by J 2 C <52 and /Uj > 0 for i G J 2 that {di,u) =0. Also it follows from r( J 2 ) C Q 2 

that {di,u) > 0 for any i G r(J 2 ) \ J 2 . Taking this into account together with (5.28) and (5.29), 

we complete the proof of the claim. 

Claim 6 : We have the representation ^{Ji,r(Ji)},{J2,r(J2)} = Q{JiP]AJ2j] “ ^{JiPldPd}- 

To verify the inclusion “d” in this claim, pick u G Q{j^^k},{J 2 ,I}~^{Ji,K},{J 2 ,I} u = Ui—U 2 

for some ui,U 2 G ^{Ji,a'},{J 2 ,/}- Choosing i G r(Ji) and j G Ji gives us 

{Oi Oj , Xl) — {Oi Oj , Ul) {Oi Oj , 'U 2 ) — 0 

due to (5.18). If i G r(J 2 ), then by using (5.18) again we arrive at 

{dt,u) = {dt,ui) - {dt,U 2 ) = 0, 


which implies in turn that u G ^{Ji,r(Ji)},{J 2 ,r(J 2 )} and thus justihes the inclusion “D” above. 

To verify next the opposite inclusion therein, take any u G ^{Ji,r(Ji)},{J 2 ,r(J 2 )} and observe 
that we are done if K = r(Ji) and I = r(J 2 ). Suppose now that either K \T{Ji) ^ 0 
or / \ r(J 2 ) 7 ^ 0 and consider for dehniteness that both sets K \ r(Ji) and I \ r(J 2 ) are 
nonempty while noting that the two other cases can be treated similarly. Pick i £ K \ r(Ji) 
and t £ I\ r(J 2 ) and hnd by (5.18) elements Ui £ G{j^^k],{J 2 J}^ P ^ and Ut £ Q{j^^k},{J 2 J] 
such that (oj — aj^,Ui) < 0 and {dt,ut) < 0. Define further 

Us := Ui + Ut^ and Xg ■= u + Us for some s > 0. 

i&K\V{Ji) t&I\T{J2) 

Since G{Ji,k},{J 2 ,i} a cone, it follows that yg £ ^{Ji,A'},{J 2 ,/}- We now assert that the inclusion 
Xg £ ^{Ji,_ft'},{j 2 ,/} bolds when s (depending only on u) is sufficiently large. If it is true, then 
u = Xg-yg£ Q{j^^k},{J 2 ,i} - G{JuK},{J 2 ,i} > which would justify the claim. 

To prove the assertion made, pick i,j G Ji and get by the choice of u G ^{Ji,r(Ji)},{J 2 ,r(J 2 )} 
and yg £ Q{j^^k},{J 2 ,i} tbe equalities 

{ai - aj,Xg) = {ai - aj,u) + (a* - aj,yg) = 0. (5.30) 

If i G r(Ji) \ Ji and j £ Ji, we are done by 

{ai - aj,Xs) = {ai - aj,u) + (a* - aj,ys) < 0. (5.31) 


It remains to examine the case of i G P \ r(Ti). Take ji £ Ji and Ui £ G{Ji^k},{J 2 ,i}^ 

{ai — aj^,Ui) < 0, and hnd s so large that (a* — aj^,u) + s{ai — aj^,Ui) < 0. Indeed, it works for 


s > 


max 

ieK\r{Ji) 



{ai aj^ , tt) 
{ai aj^ , Ui) 


21 



This allows us to proceed with the relationships 


Ifli — (Oj + (flj Clj^jUs) — (flj Clj^,v}j -\- sifli (lj^,Ui) 

T^^2 cij ^, s ^ ^ ^ y^r T ^ ^ ^ ^ ip^i yji^y) T ^{yi yj^^ yi) p 0* 

reK\r(Ji),rpi tG/\r(J 2 ) 

Using this together with (5.30) implies for any r £ Ji that 


(^CLi CL^^Xg) — (pi CLj^^Xg) p {Pji yr^y^s) — {pi yji^y^s) P 0 . 


Take now t £ J 2 and observe that {dt,Xs) = {dt,y) + {dt,ys) = 0, while for t £ r(J 2 ) \ J 2 
we have {dt,Xs) = {dt,y) + {dt,ys) < 0. Finally, consider the case of t € / \ r(J 2 ) and pick 
ut £ Q{Ji^k},{J 2 P}- It follows from {dt,yt) < 0 that {dt,y) + s{dt,yt) < 0 when 


s > 


max 

tGi\r{j2) 



{dt,u) \ 
{dt,yt)) 


Therefore we are able to deduce from the above that 

{dt,Xs) = {dt,y) + {dt,ys) = {dt,y) + s(^dt,yt) + {dt,s(^ X] 

ieK\r(Ji) rei\r{j2),rj^t 

< {dt,y) + s{dt,yt) <0- 


Combining these pieces shows that Xg £ 0 {Ji,k},{J2,i} 1°^ large s > 0, which justifies the claim. 

Having in hands the verihed claims allows us conclude that the selected vector u £ M” 
belongs to the set on right-hand side of (5.19). Indeed, take i,j £ r(Ji) and deduce from 
Claims 5 and 6 that —y = ui — U 2 for ui,U 2 G G{Ji,k},{J 2 ,i}- Then it follows from (5.18) that 
(oj — aj,y) = {tti — yj,y 2 ) — {yt — yj,yi) =0. If t G r(J 2 ), we again employ (5.18) to get 
{dt,y) = {dt,y 2 ) — {dt,yi) = 0, which thus completes the proof of the theorem. A 

Now we consider specifications of Theorem 5.2 in two important cases given by the summands 
in representation (3.3) of general CPWL functions. The first case below concerns the indicator 
function Sn{-) of the polyhedral set Q = dom^? corresponding to (3.3) without the maximum 
function part. The obtained representation is equivalent to the one in [9, Proposition 4.4] while 
being more simple and convenient for implementations. 


Corollary 5.3 (second-order subdifferential domain for indicator functions of convex 
polyhedra). Let a* = 0 G and a* G M for all i £Ti in the setting of Theorem 5.2. Denoting 
H := dom^?, we have the second-order subdifferential formula 


domd^(5n(a:,u) = |tt G M” {dt,u) = 0, t £ r(J 2 )|. 


Proof. Follows immediately from (5.19) with a* = 0 and Oj = 0 therein. 
Another particular case of (3.3) is the maximum function 


<^max(a;) := max|(ai,x) - oi,..., (a«,x) - a«|, 


A 

(5.32) 


with corresponds to (3.3) with dom(/9 = R”. Its significant specification, where a* = e* is the unit 
vector in R"" such that the i*^ component of it is 1 while the others are 0 and where Oj = 0 G R 
for any i G Ti, is given by the component maximum function 


(/)(x) := maxjxi,..., Xn} for x = (xi,..., x^) G R”. (5.33) 

The next consequence of Theorem 5.2 gives us a constructive formula for the second-order 
subdifferential domain of iprunx and reduces to [8, Theorem 3.1] in the case of (5.33). 
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Corollary 5.4 (second-order subdifferential domain for maximum functions). For 

V^max given in (5.32) we have in the notation of Theorem 5.2 that 

dom8“^ipma.x{x, v) = |u € M” (oj — aj,u) = 0 for all i,j € r(Ji)|. (5.34) 

In particular, for the component maximum function (5.33) we have 

domd^(^(x,-u) = |u = («i,..., «n) G Ui = c for all i ^ (5.35) 

with some constant c G M. 


Proof. Formula (5.34) follows immediately from Theorem 5.2. It yields representation (5.35) 
by observing that r(Ji) = Ji if ai = for any i G Ti. A 

Now we go back to the general case of CPWL functions 99 from (3.1) and derive results on 
the second-order subdifferential values expressed entirely in terms of the initial data of (3.1) by 
using Theorem 5.2. First we derive an upper estimate of these values without any additional 
assumptions. To proceed, for {x,v) G gpdip and u G domd^ 99 (x, u) define the index sets 

/o,i(u) := G K{x) {ai - aj,u) = 0 for j G Jij, 

Iy^i{u) := |z G K{x) {tti — aj,u) > 0 for j G Ji|, (5.36) 

h, 2 {u) := |t G I{x) {dt,u) = o|, I>, 2 {u) := |t G I{x) {dt,u) > 0 for j G J 2 ^. 

Theorem 5.5 (upper estimate for second-order subdifferential values of CPWL func¬ 
tions). Given u G doviid‘^tp{x,v) in the setting of Theorem 5.2, we have the inclusion 


d‘^<p{x,v){u) C span|ai — aj i,j G +cone|ai — aj i G />^i(u), j G 

-|-span|(it t G/o,2('w)| + conejdt t G/>,2(it) ■ 


(5.37) 


in terms of the initial CPWL parameters from (3.1) and the index sets from (5.36). 


Proof. By constructions (2.8) and (2.7) for u G doTnd‘^(p{x, v) we find w G d‘^(p{x, v){u) such that 
{w,—u) G A((x, 7), gphd^j). Applying Theorem 5.1, we find index subsets (Pi,Qi,P 2 ,Q 2 ) G 
with (Pi)P 2 ) & D{x,v) for which 

(w,-u) G -P{Pi,Qi},{P2,Q2} ^ ^{Pi,Qi},{P2,Q2}- 

Define Si := {i G Qi\ (a* — aj,u) = 0 if j G Ji} and S 2 '■= {i G Q 2 \ {dt,u) = 0} and deduce 
from equality (5.27) in the proof of Theorem 5.2 that (a^ — aj,u) = 0 whenever j G Ji and 
i G Pi, which shows that Pi C Si. We also have P2 C S2 due to —u G f?{Pi,Qi},{P2,Q2}- These 
observations together with w G ^{Px,Qi},{P 2 ,Q 2 } us that 


w 


G span• 

^O'i 

- aj i,j G Pij 

-|- cone|aj — aj\ 

-l-span <j 

di 

i G P2I + conej 

i G <52 \ P2 

C span 

|a, 

: - aj i,j G 5i| 

-|- cone|aj — aj 

-l-span <j 

di 

f G ^2! -I- cone<j 

i € Q2 \ S 2 


{i,j) G (Qi\Pi) xPi} 
{i,j)e{Qi\Si)xSi] 


Then (5.37) follows from Si C /o,i(^)) S 2 C Iq^2{u), Qi\Si C />q(n), and Q 2 \S 2 C. I>^ 2 {u). A 

Next we establish effective conditions for the equality in (5.37), i.e., for a precise formula to 
calculate the second-order subdifferential of a general CPWL function via its initial data. It is 
shown below that the following qualification condition is sufficient but not necessary for this. 
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Definition 5.6 (affine independence qnalification condition). Given (p G CPWL with 
X G dom(/9, we say the affine independence qualification condition (AIQC) holds for p 
at X if for the generating veetors ai and dt indexed by {i,j) G K x I with I = I {x) and K = K{x) 
the vectors {(a*, 1) G M"- x M| f G K} U {(iit,0) G M” x R| t G /} are linearly independent. 

It is clear that AIQC is implied by the linear independence of the vectors {ai\ i G it'(x)} U 
{dt\ t G I{x)}, but not vice versa. Let us present some useful consequences of AIQC. 

Proposition 5.7 (consequences of AIQC). Under the validity of AIQC for p at x we have 
r(Ji) = Ji and r(J 2 ) = J 2 for the feature index sets in (5.18). 

Proof. Note that the assumed AIQC ensures the the existence of {x,Xn+i) G M” x M such that 

{ai,x) + Xn+i = 0 for i G Ji, (a*, x) + x^+i =-1 for i G K{x)\Ji, SSi 

{di,x)=0 for i G J 2 , and {di,x) = —1 for f G/(x) \ J 2 . 

This implies by definition (4.15) that x G G{Ji^k{x)},{J 2 ,i{x)}j which yields in turn the claimed 
equalities r(Ji) = Ji and r(J 2 ) = J 2 . A 

Now we are ready to accomplish the aforementioned precise calculation of second-order sub¬ 
differential values and, as a by-product, to establish the second-order subdifferential sum rule in 
a fully nonsmooth setting, which seems to be the first result of this type in the literature. 


Theorem 5.8 (precise formula for second-order subdifferential values of CPWL func¬ 
tions under AIQC). Assume in the setting of Theorem 5.5 that AIQC holds for p at x. Then 
we have the precise calculation formula 


d‘^p{x,v){u) = span|aj — aj i,j G /o,i(tt)| -|-cone|ai — Oj i G />q(u),j G /o,i(ti)| 

-|-span|(it t G /o,2(i^)| -f cone|(ii t G I>p{u) • foru G dom d'^ dp{x, v). 


(5.39) 


Furthermore, the exact sum rule for the second-order subdifferential of p = pi -\- p 2 holds: 

d‘^p{x,v){u) = d‘^pi{x,vi){u)-\-d‘^P 2 {x,V 2 ){u), u G domd‘^dp{x,v) (5.40) 

with pi{x) := Pmaxix) from (5.32), P 2 ix) := (5(x;dom(^) while vi and V 2 are taken from (3.12). 


Proof. The inclusion “c” is obtained in (5.37). To verify the opposite inclusion, pick any 
w from the set on the right-hand side in (5.39). Select Pi = Iop{u), Qi = Iop{u) U />q(n), 
P 2 = hpiu), and Q 2 = hpiu) U I>, 2 {u) and get 

(■W, -u) G P{Pi,Qi},{P2,Q2} ^ ^{Pi,Qi},{P2,Q2}- (5-41) 

Define xi := x -|- tx for t > 0 , where x solves the system 

{ai-aj,x) = 0 for i,jGQi, {ai-aj,x) = -l for {i,j)G{K{x)\Qi)xQi, 

{di,x )=0 for i G Q2, and {di,x) = —1 for i G I{x)\Q2. 

Such a solution exists under AIQC due to Proposition 5.7, which allows us to replace Qi by Ji 
and D 2 by J 2 and thus to reduce (5.42) to system (5.38) considered above. 

We claim now that xt G ™ (5-2). Indeed, it follows directly from the equalities 

K{xt) = Qi and I{xt) = Q2 when t > 0 is sufficiently small. To finish the proof of (5.39), it 
remains to show that (Pi,P 2 ) G D{x,v) with D{x,v) taken from (5.1). Since u G domd‘^p{x,v), 
it follows from (5.19) that Ji C Io,i{u) = Pi and J2 C InpixL) = P2- On the other hand, we 
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know from (3.12) that (Ji, J 2 ) € D{x,v), which ensures therefore that (^ 1 ,^ 2 ) € D{x,v). The 
latter implies that (Pi, Qi,P 2 , Q 2 ) € A with A taken from (5.3). Employing finally Theorem 5.1 
together with (5.41) yields w € d‘^ip{x,v){'>j) and thus justifies (5.39). The second-order sum 
rule in (5.40) is an immediate subsequence of (5.39). A 

The precise calculation of the second-order subdifferential for CPWL functions in (5.39) via 
their initial data opens the gate for a variety of applications to numerous issues of variational 
analysis and optimization, which will be considered in our subsequent research. Recall that 
compositions of CPWL functions with C^-mappings produce a major subclass of fully amenable 
functions frequently appeared in many aspects of variational analysis and optimization; see, e.g., 
[27] and also [20] for more recent developments. The exact chain rule for such compositions was 
derived in [20, Theorem 4.3] under a certain second-order qualification condition involving the 
second-order subdifferential of a CPWL outer function. The precise calculation in (5.39) makes 
these results more efficient for further implementations. 

6 Some Particular Cases 

In this section we revisit the second-order subdifferential calculations for some types of the 
maximum functions obtained recently in [ 8 ] and [7] and then derive, being motivated by these 
papers, new results in this direction based on Theorem 5.1. Let us start with the component 
maximum function (5.33). The following result was obtained in [ 8 , Theorem 3.1] by reducing 
the problem to the polyhedral framework of [ 6 ] with the subsequent usage of the critical face 
condition. Our approach is more direct presenting a straightforward application of Theorem 5.8. 

Proposition 6.1 (calculating the second-order subdifferential of the component max¬ 
imum function). Let be given in (5.33) with u = (mi, ..., Un) € dom.d‘^(j){x, v). Then we have 
Ui = 'y for all f G Ji = J+(x, ui) for some constant 7 G R and also />,i(tt) = {i G K{x)\ Ui > 7 }. 
Furthermore, the following representation holds: 

n 

d‘^fi{x, !;)(«) = < tc = (tci,..., Wn) G R” Wi = 0, Wi > 0 if i £ ly i(tt), 

'' ' tt ’ ( 6 . 1 ) 

Wi = 0 if i £ {Ti\ K{x)) U /< 7 (tt)|, 
where the index set /< 7 (u) := {i £ K{x)\ Ui < j}. 

Proof. Given u £ dom.d‘^fi{x,v), it comes from (5.35) that Ui = j with some 7 G R whenever 
i £ Ji- Remembering that Ui = ei £ R” as i G Ti and plugging this into (5.36) give us 
= {i £ K{x)\ Ui > Uj for j £ Ji} = {i £ K{x)\ Ui > 7 }. Now take w £ d‘^(l){x,v){u) and 
observe the validity of AIQC in Theorem 5.8. Thus we get 

d‘^(t){x,v){u) =spwa^ei-Cj i, j G/o,i(tt)|conejcj - e^- f G/>,i(u), j G/o,i(i^) }, ( 6 . 2 ) 

where 7o,i(^^) = {i £ K{x)\ui = 7 }. This leads us to the representation 

w = ^ \ij{ei - ej)+ ^ M 7 '(ei - ^j) with \ij £ R, > 0, 

(*d)e/o,i(«)x^,i W (*d)e/>,iG)xi'o,i W 

which implies that — 6 rci > 0 for f G /> 7 (u). Since 7o,i(^^) C K{x) and C 

K{x), there is no vector e* with i £ (Ti \ K{x)) U /< 7 (tt) in (6.2). This yields rcj = 0 for 
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i G (Ti \ K{x)) U and shows that w belongs to the set on the right-hand side of (6.1). 

To verify the opposite inclusion, take w from the latter set for some u G donid‘^4>{x,v) and get 

Wi + Wi = 0 with Wi > 0 for i G/>p(u). 

If rc = 0, then we have w G d‘^4>{x,v){u) due to (6.2). Otherwise, let r G /o,i('*^) and observe 
that Wr = -(Eie/>,i (0 which leads us to 

w = Wi{ei - er)+ Wi{ei - e^) 


and yields w G d‘^cj){x,v){u) by the above representation of w. A 

To proceed further, note that we Theorem 5.1 for the maximum function (5.32) gives us 

9 ^</ 5 max(x,ui)(u) = ju; G M"- {w,-u) G X with (Pi,Qi) G (6.3) 


where u G M"" and vi is from (3.11). This fact has not been observed in [8], where the authors 
only consider either the case of a* = e* for i G Ti, or the case where the vectors a*, i G K{x), 
are affinely independent in the sense of Definition 5.6; see [8, Theorem 3.1 and Theorem 4.2]. 
Then it was explored in [7] for some other particular cases of the maximum function under the 
validity of AIQC. In the rest of this section we obtain, on the basis of (6.3), new results in this 
direction that cover the aforementioned particular cases under AIQC while also encompass more 
general settings where AIQC does not hold and the results of [8] and [7] cannot be applied. 

First we address the so-called oo-norm function 

</>oo(a:) := llxjjoo = max||xi|,..., |xn|| for x = (xi,..., x^) G M"-. (6.4) 

To rewrite (6.4) in form (5.32), observe that 4)oo{x) = max{xi,..., x^, —xi,..., —x^} and so 


■ 0 oo(a;) = max|(ai,x),..., (a2n,a:)| with 0 ^ = 6 * and Un+i =-et, i = l,...,n. 

Explicit formulas for calculating d‘^(j)oo{x,v) entirely via the initial data were derived in [7] in 
the two cases: (a) x = 0 with v G int cl(/>oo(ai) and (b) x 7^ 0. The most delicate and important 
case of X = 0 with v G bdcl(/)oo(:K) has not been resolved in [7] due to the violation of AIQC in 
this setting. Now we are able to proceed in this case based on Theorem 5.5 and formula (6.3). 

The next calculation formulas for the domain and values of d‘^(j)oo{x,v) make use of the 
classical sign function sgn (x) equal to 1 if x > 0 , to 0 if x = 0 , and to —1 if x < 0 . 


Theorem 6.2 (second-order subdifFerential of the oo-norm function). Considering the 
oo-norm function (6.4) with x = 0 and v = {vi,... ,Vn) G hddcpcaix), define 


Joo ■— ^i G {1,..., n} Vi 7 ^ 0^ and .— {1,..., n} \ Ja 


Then we have the following assertions: 

(i) The domain of d'^fioo o,t (x, v) is calculated by 


dom 5^000 (x, x) = |« = {ui, ..., Un) G M” sgn {vi)ui = 7 for all i G Joo|, 


where 7 G M is some real constant. 
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(ii) We have the following upper bound for the value of d‘^(j)oo{x, v) at any u € dom d‘^(f)oo{x, v): 

d'^(poo{x,v){u) C span - ujej i, j G Li(n) U Jooj 

+cone|/Uiei — i/jCj {i,j) G L 2 {u) x (Li (n)U Joo)}, 

where the index sets Li{u) and L 2 {u) are defined by 


(6.5) 


Li 


(u) := G Ui = ^ or -Ui = 7 | and L 2 {u) := G Ui > 'y or — Ui > 7 | 


with the constant 7 G M taken from (i) and 


Vi := 


1 if Ui=J 
-1 if -Ui = 7 


for i e Li{u)D Joo, 


hi ■= 


for i G L 2 {u). 


1 if Ui> j 
-1 if -Ui > 7 

Furthermore, equality holds in (6.5) for n = 0 and for u = {ui,... ,Un) G dom.d‘^(f)oo{x,v) 
satisfying min{wj, —Ui} < 7 whenever i G {1,... , n}. 


Proof. It is easy to see that K{x) = {!,..., 2n} for the active index set (3.5) when x = 0. 
Furthermore, we have the representations 

V G dcfooix) = cojoi,... ,a 2 n| X G N{v-,lBi), 

where Bi := {y = {yi,... ,yn)\ ||y||i := Yh=i \yi\ <_!}, and where Oi = Ci G M” and Un+i = 
-Ci G M” for i = 1,... ,n. Thus there are multiplies A* > 0 for i G K{x) such that 

V = XiUi and Aj = 1 with A^Aj+n = 0 for i G Lr(x) n {1,..., n}. (6.6) 

iGK{x) i^K(x) 


Remembering from (3.13) that Ji = J+(x,ui) = {i G K{x)\ Aj > 0} with vi = v and using 
V G bd9(/>oo(S), we get that ||i;||i = 1^*1 = 1- Combining this with ( 6 . 6 ) gives us 


J l^’il if i < n 

\ \vi-n\ if i > n 


and ai 


We deduce from (6.7) the implications 


5gn(S.)ei ifi<n ^ ^ j 

sgn[vi_n)ei-n II ^ > n 


i G Ji 


i G Joo if i < n 

i — n G Joo if i > n 


j i G Ji if sgn (vi) > 0 
( i + n G Ji if sgn (uj) <0 . ' 


(6.7) 


( 6 . 8 ) 


To justify now assertion (i), we apply Theorem 5.4 along with (5.34) and arrive at 
domcl^(/)oo(x, 7 ) = |u = (ui, ..., Un) G M” {ai — aj,u) = 0 for all i,j G r(Ji)|. 


(6.9) 


Since domi/ioo = M"", we drop for this function the indexes related to the second summand in 
(3.3). Letting K := K{x) and taking into account that Ji G K together with (4.15), (6.7), and 
(6.8), we prove the following claim that gives us a constructive representation of G{j^^k}' 
Claim: The set G{j^^k} from (4.15) in the case of (6.4) admits the representation 


U = (Ui, ...,Un)G G{d,K} { 


sgn {vi)ui = sgn {vj)uj 
\ui\ < sgn {vj)uj 

Ui > 0 
Ui < 0 


if i-i j ^ G 001 
if {i,j) G X Joo, 
if sgn {vj) > 0, 
if sgn {vj) < 0. 


( 6 . 10 ) 


27 



We begin with verifying the inclusion “c” in (6.10). Pick u G G{Ji^k} get by (4.15) that 

(oj — aj,u) = 0 for all i,j G Ji. (6-11) 

Letting first i,j G Joo gives us i,j < n, Vi ^ 0, and Vj ^ 0. Consider the following cases: 

(1) sgn (uj) > 0, sgn {vj) > 0. This leads us to i,j G Ji, a* = sgn {vi)ei, and aj = sgn {vj)ej. 

We get sgn {vi)ui = sgn {vj)uj by (6.11), and thus u belongs to the right-hand side of (6.10). 

(2) sgn(i;j) > 0, sgn(i;j) < 0. This means that i G Ji, j -|-n G Ji, and therefore we 
conclude that ai = sgn(i;j)ei and aj = sgiii{vj+n-n)^j+n-n = sgn{vj)ej. Using (6.11) implies 
that sgn {vi)ui = sgn {vj)uj and thus u belongs to the right-hand side of (6.10). 

(3) sgn(i;j) < 0, sgn(i;j) > 0. We can treat this case similarly to (2). 

(4) sgn(i;j) < 0, sgiii{vj) < 0. We can treat this case similarly to (1). 

Consider next the case of (z,j) G x Jqo in (6.10), which gives us j < n and Vj ^ 0. Let 
for definiteness i <n observing that the other case of i > n can be treated similarly. Supposing 
that i G Ji, we deduce from (6.8) that i G Joo, a contradiction. This justifies that i G K \ Ji, 
which together with the condition i < n tells us that ai = e^. Employing now (4.15) shows that 

Ui = {ai,u) < {aj,u) = sgn{vj)ej. (6-12) 

On the other hand, we observe that i -|- n G ET \ Ji. Indeed, if i -|- n G Ji, it follows from (6.8) 
that i = i + n — nG Joo, a contradiction. Using this observation confirms that Oj+n = —e*, and 
thus we get —Ui = {ai+n,u) < (aju) = sgn{vj)ej by (4.15). Taking it into account along with 
(6.12) yields \ui\ < sgn{vj)ej, and thus u belongs to the right-hand side of (6.10). 

Considering further the case of sgn(i;j) > 0 in (6.10), we need to verify that Ui > 0. To 
furnish this, deduce from sgn(i;j) > 0 that j G Joo, and thus it follows from (6.8) that j G Ji. 
Since j < n, we get from (6.7) that aj = ej. Moreover, it results from (6.6) that j -|- n G iL \ Ji, 
which tells us that Oj+n = —ej. Appealing now to (4.15) implies that 

Uj — u) ^ (ttj , u) — Uj, 

and thus leads us to uj > 0. The remaining case of sgn (vj) < 0 in (6.10) can be done in similarly 
to the the previous one, and thus we finishes the proof of the inclusion “c” in (6.10). 

Our next task is to verify the inclusion “D” in (6.10). Let us first show that equality (6.11) 
holds if i, j G Ji. We split the proof of it into the following cases: 

(a) i,j < n. This yields (6.8) by i,j G Joo- Observe from (6.7) that a* = sgn(i;j)ei and that 
Uj = sgn{vj)ej. Using it along with the relations in (6.10) confirms the validity of (6.11). 

(b) i > n, j < n. Employing (6.8) in this case leads us to i — n G Joo and j G Joo- It allows 
us to deduce from the relations in (6.10) and (6.7) that 

{ai,u) = {sg-n.{vi-n)ei-n,u) = sgn (!;*_„)«*_„ = sg-n.{vj)uj = (sgn(%)ej,u) = (aj,u), 

which thus verifies the validity of (6.11) in this case. 

(c) i < n, j > n. This case can be treated similar to case (b). 

(d) i > n, j > n. We can prove that equality (6.11) holds similarly to case (a). 

To finish the proof of the claim, it remains to justify the validity of the inequality {ai—aj,u) < 
0 provided that i G K\Ji and j G Ji- Here again we need to consider several different cases for 
i and j. Eor brevity we consider only the case of i,j < n while observing that the other cases 
can be done similarly. It follows from the the relations in (6.8) and (6.7) that j G Joo and that 
aj = sgn {vj)ej. Since i < n, we get a* = e*. If i G J!^, then it follows from (6.10) that 

{ai,u) = Ui< sgn{vj)uj = (sgn {vj)ej,u) = {aj,u), 


28 



which brings us to the claimed inequality. Otherwise we get i € Joo and observe that sgn (uj) < 0 
and hence Ui < 0 by (6.10). Considering further i <n tells us that ai = e*, and thus it follows 
from the relations in ( 6 . 10 ) that 

{ai,u) =Ui< -Ui = sg-a{vi)ui = sgn{vj)uj = {sg-a{vj)ej,u) = {aj,u), 


which therefore completes the proof of the claim. 

To continue with the proof of the theorem, pick i € r(Ji) for j G Ji and suppose that 
j < n. It follows from (5.18) and (6.7) that {ai,u) = {aj,u) = sgn {vj)uj for all u G Q{Ji,k}- 
This together with (6.10) yields i G Ji, since otherwise there is u from (6.10) violating {ai,u) = 
sgn{vj)uj. To see it, suppose that i G r(Ji) and i ^ Ji. Suppose further that i < n; the other 
case i > n can be treated similarly. There are two possible subcases here: either (a) i G Joo, 
or (b) i ^ J^. If in the first (sub)case we assume that sgn(i;i) > 0, then ( 6 . 8 ) yields i G Ji, a 
contradiction. Thus we have sgn(i;i) < 0 that leads us by ( 6 . 8 ) to i + n G Ji. It follows from 
u G G{,Ji^k} that (oj+n — aj,u) = 0, which tells us that —Ui = sgn{vj)uj. Employing the latter 
together with Ui = {ai,u) = sgn{vj)uj yields Uj = 0. This means that for any u G G{Ji^k} we 
must have Uj = 0, which contradicts (6.10). 

Considering further (sub)case (b) above, we get (i, j) G J^ x Joo. Select u G G{j^^k} so that 
Ui < sgn {vj)uj, which is possible due to (6.10). This contradicts the fact that Ui = {ai,u) = 
sgn {vj)uj for all u G G{Ji^k} thus verifies the inclusion r(Ji) C Ji. Similar arguments work 
for the case of j > n. Since the opposite inclusion Ji C r(Ji) is trivial, we arrive at r(Ji) = Ji 
and, combining it with ( 6 . 8 ) and (6.9), justify assertion (i) of the theorem. 

Next we verify assertion (ii). Pick u G donid‘^(pooix,v) and get from Theorem 5.5 that 


d‘^(f)oo{x,v){u) C span|ai — aj i,j G /o,i(n)| +cone| 


a,' — a. 


i G I 


>,i(u), j G /o,i(^^)}- (6.13) 


Implementing (5.36) and (6.7) gives us the equivalences 


i £ Io,i{u) i e K{x), {ai,u)=j 


i G Ji(u) U Joo if i < n, 
i — n G Li(u) U Joo if i > n, 


(6.14) 


i G L\{u^ U Joo 


i G /o,i(«) if Ui = 7, 

i + nG/o,i(u) if -Ui = j, 


i G />q(u) i G K{x), {ai,u) > 7 


i G L 2 {u) if i < n, 

i — n £ L 2 {u) if i > n, 


( i £ />,i(tt) if Ui > 7 , 

\ i + nG/>,i(u) if -Ui>'^, 


(6.15) 

(6.16) 
(6.17) 


which justifies inclusion (6.5) in (ii). To prove further the equality therein in the cases claimed 
in the theorem let us verify that the inclusion “d” holds in (6.13) when either (a) the vector 
u = (ui,..., Un) £ dom8“^4)oo{x, v) satisfies min{uj, —Ui} < 7 for alH G {f, ..., n}, or (b) u = 0. 
To proceed, pick w from the set on the right-hand side in (6.13) and denote Pi := 7o,i(^^) and 
Qi := Io,i(u) U -^>,i(u)- This yields 


(w, -u) £ T X (6.18) 

Observe furthermore that in case (a) we have K{x) = Qi with x = (xi ,..., Xn) given by 

{ 1 if f G Qi n {1,... ,n}, 

— 1 if n-|-f G Qi n {n-|-1,..., 2n} 

0 otherwise 
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for all i = 1,..., n. In case (b) we also have K{x) = Qi for x = 0. This results in ^ 0 

for the set defined in (5.2) without Q 2 - To finish the proof of the equality in (??), it remains 
to show that Pi G D{x,v) with D{x,v) taken from (5.1). Indeed, with u € domcl^(/)oo(x, u) we 
get from (5.19) that Ji C /o,i('*^) = Pi- By Ji G D{x,v) it follows that Pi G D{x,v) and hence 
{P 17 Q 1 ) G with A defined in (5.3). Employing finally Theorem 5.1 yields w G d‘^(j)oo{x,v){u), 
which verifies the inclusion “d” in (6.13) in both cases for u under consideration. To finish the 
proof of (ii), it suffices to combine (6.13), (6.14), and (6.16). A 

Remark 6.3 (failure of AIQC for (/>oo)- Observe that AIQC fails in the setting of Theo¬ 
rem 6.2, but we still have the equality formula for the second-order subdifferential of (^ 00 • Note 
that the role of AICQ in the proof of Theorem 5.8 is to ensure that Plyq^ q^y A ^7 B(Ji) = Ji, 
and r(J 2 ) = J 2 . As Theorem 6.2 shows, this can be obtained even in the absence of AICQ. 


Next we proceed with calculating the second-order subdifferential of the 1-norm function 

n 

())i(x) := ||x||i = |xi| for x = (xi,..., x^) G M"". (6.19) 

i=\ 

Basic convex analysis tells us that (()i(x) can be represented as the conjugate to ttie 

indicator function of the ball iBoo := {v = (yi, • • • ,yn) G lll/lloo < !}• Therefore 

u ^ d‘^(fi{x,v){w) —w ^ d‘^ 5 ]B^{v 7 x){—u) for (x, h) G gph9(/>i. (6.20) 


The following theorem provides a precise and explicit calculation of the second-order subdif¬ 
ferential of diBoo terms of the initial data, which then allows us to calculate this construction 
for the 1-norm (6.19). Since in the case of u G intiBoo we trivially have iv,x){u) = {0} 

for any u G M”, the emphasis below is on the boundary case where v G bdlBoo. 


Theorem 6.4 (second-order subdifFerential of 5]b^)- Let x G dSjB^ = N{v-,lBoo) with 
V = (hi, ..., Vn) & bdiBoo- Then we have the preeise formulas: 

(i) The domain of d‘^5]B^{v,x) is calculated by 

domd^(JiB^(h,x) = |u = (ui, ... ,Un) G M"" Ui = 0 for all i G/oo| 

with the index set loo := |f G {1,. .. , n} x* / o|. 

(ii) For any u G domd^(JiB^(h, x) the seeond-order subdifferential values are calculated by 

d‘^6iB^{v,x)iu) = span^ei f G Ei(n)|-|-conejhiei i G £'2(u)|, 
where the index sets Ei{u) and E 2 {u) are defined by 


Ei{u) := |z G H{v) Ui = o| and E 2 {u) := |f G H{v) 
as some subsets of H{v) := {i ^ {1,... with |hi| = 1}. 


ViUi > 0 


} 


Proof. We begin by observing the polyhedral representation of the ball in question: 
-®oo = |y = (yi, • • • ,yn) e IR"" {di,y)<l for f = l,... ,2n| 


( 6 . 21 ) 


with di := Ci G M” and dn+i '■= — e* G as i = 1,... ,n. It follows from v G bdlBoo that 
I{ov) A 0 the active constraint indexes (3.8) in (6.21) and that the generating vectors 
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{di\ i G Hv)} are linearly independent. By x G N{v-,]Boo) and the normal cone representation 
(3.10) we find /i* > 0 for i G I{v) such that x = (xi,... ,Xn) = This allows us to 

obtain by (3.13) with J 2 := J^{x,v) the explicit expressions for the multipliers: 


Mi = 


\xi\ li i <n 
\xi-n\ if i > n 


for i G J 2 . 


Employing (6.22) and recalling the notation from the statement in (i), we get 


i G J 2 


i ^ loo if i < n 
i — nG/00 ifi>n J’ 


i G Jo 


i G J 2 if sgn (xj) > 0 
i + n G J 2 if sgn (xj) < 0 


( 6 . 22 ) 


(6.23) 


After these preparations we are ready to prove both assertions of the theorem. Since the 
vectors {di\ i G I{v)} are linearly independent, AIQC holds and ensures by Lemma 5.6 that 
r(J 2 ) = J 2 , which verifies (i) by using (6.23) and Corollary 5.3. To justify (ii), we apply 
Theorem 5.8 ensuring the equality 


9‘^^iBc^iv,x){u) = span|(ij i G /o, 2 ('w)| +cone|d, 
Combining (5.36) and (6.22) leads us to the relationships 

i ^ h, 2 {u) i e I{v), {di,u)=^ = 


i G L 


>,2(^i)}- 


i G Ei(u) if i < n 

i — n € Ei{u) if i > n 


i G Ei{u) = 
i G I>, 2 {u) i G I{v), {di,u) > 0 
i G E2{u) = 


i G -^0,2 (it) if sgn(ui) > 0 , 

i + n G Io, 2 {u) if sgn (uj) < 0 , 


i € E 2 {u) if z < n 
i — n G E 2 {u) if z > n 


(6.24) 

(6.25) 

(6.26) 
(6.27) 


(6.28) 

A 


i G I>,2{u) if sgn(z;i) > 0 , 

z + n G I>, 2 {u) if sgn {vi) < 0, 

which verify the formula in (ii) and thus complete the proof of the theorem. 

As a consequence of Theorem 6.4, we derive now explicit formulas for calculating the domain 
and values of for the 1-norm function (6.19). These issues have been recently addressed in 
[7, Theorem 4], where equivalent results have been derived by a different way. 


Corollary 6.5 (second-order subdifferential of the 1-norm function). The following 
assertions hold in the notation Theorem 6.4 with (x,v) G gphd(/)i.- 
(i) The domain of d‘^(j)i{x,v) is calculated by 


domd^(/)i(x, u) = |zt; = (zci,..., zcn) G M” Wi = 0 for all z G {1,... , n} \ 77(z;)|. 
(ii) For any w G domd^(/)i(x, u) we have 


d'^(j)i{x,v){w) = jzz = (zzi, ...,Un) 


G 


zzj = 0 if i G C2{w) U loo, 

ViUi <0 if i G Ci{w) \ C 2 {w) |, 

where the index sets Ci{w) and C 2 {w) are defined by 

Ci{w) := |z G H{v) Wi o| and C 2 {w) := |z G H{v) Wi 7 ^ 0, ViWi > o|. 


(6.29) 
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Proof. Combining (6.20) and Theorem 6.4 tells us that u G d‘^(l>i{x,v){w) amounts to 


-u G |u = (ui,... ,Un) G 


Uj = 0 for all i G Ir 


—w G 


■} 


span|ei i G £'i(—u)| +cone|uiei i G E 2 {—u) | 


(6.30) 


It follows from Ei{—u) U E 2 {—u) C H{v) that Wi = 0 whenever i ^ H{v). This together with 

(6.30) verifies the inclusion “c” in (i). To justify the converse inclusion, take w from the set on 
the right-hand side in (i). Using Theorem 6.4, we get w G d‘^5]B^{v,x){u) for u := 0 G This 
along with ( 6 . 20 ) leads us the inclusion ”d” in (i) and thus completes the proof of (i). 

The verification of (ii) is a bit more involved. Pick {w,u) G gphd‘^(j)i{x,v) and observe 
that ut = 0 for all f G loo by (6.30). Then for each t G 6 * 2 (rc) there are two possible cases: 
either (a) wt > 0 and ut = 1, or (b) wt < 0 and vt = —1. We claim that ut = 0 in both 
cases. Indeed, suppose on the contrary that ut 7 ^ 0 in case (a). It results from wt ^ 0 that 
t G Ei{—u) U E 2 {—u). By ttt 7 ^ 0 we deduce that t G E 2 {—u). Employing this together with 
Vt = 1 yields ut < 0, which means that the coefficients for et in (6.30) are nonnegative. Thus 
Wt <0, a contradiction. Similar arguments lead us to a contradiction in case (b). 

Next we pick t G Ci{w) \ 6*2 (tc) and consider again the two possible cases: either (1) wt > 0 
and Vt = —1, or (2) wt < 0 and vt = —1- In case (1) we have ut > 0 since t G Ei{—u) U E 2 {—u). 
This shows that vtUt < 0. Case (2) is treated similarly. Thus both these cases give us vtUt < 0 
for all t G Ci{w) \ (72 (tc), which justifies the inclusion “c” in (6.29). 

To verify the opposite inclusion in (6.29), let u = (ui,... ,Un) belong to the right-hand side 
of (6.29). Remembering that w = {wi,... ,Wn) G domd‘^(j)i{x,v), we need to prove that both 
inclusions in (6.30) are satisfied. In fact, the first one follows immediately due to u* = 0 for all 
i G C 2 {w) U loo- To check the second inclusion in (6.30), fix any component tCj 7 ^ 0 of tc for 
i G H{v) and suppose that wt >0. If Uj = 1 in (6.30), then i G C 2 {w) and hence Ui = 0, which 
implies that i G Ei{—u). On the other hand, for Uj = — 1 we get i G Ci{w) \ C 2 {w), which yields 
i G Ei{—u) \J E 2 {—u). Similar arguments are applied to the case of rcj < 0, and hence we have 

(6.30) . It justifies the inclusion “D” in (6.29) and so completes the proof of the corollary. A 
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